The noun extensionality can be countable or uncountable.
The singular form of extensionality is also extensionality.