The noun all that and a bag of chips is uncountable.
The plural form of all that and a bag of chips is also all that and a bag of chips.