The noun square notation is uncountable.
The singular form of square notation is also square notation.