The noun umbrage can be countable or uncountable.

In more general, commonly used, contexts, the plural form will also be umbrage.

However, in more specific contexts, the plural form can also be umbrages e.g. in reference to various types of umbrages or a collection of umbrages.