The noun alabaster can be countable or uncountable.
The singular form of alabaster is also alabaster.