The noun Oxford blue can be countable or uncountable.
The singular form of Oxford blue is also Oxford blue.