The noun rice vinegar can be countable or uncountable.
The singular form of rice vinegar is also rice vinegar.