The noun rhythmus can be countable or uncountable.
In more general, commonly used, contexts, the plural form will be rhythmuses.
However, in more specific contexts, the plural form can also be rhythmi e.g. in reference to various types of rhythmi or a collection of rhythmi.