We do not currently know of any antonyms for rile up.
The verb rile up is defined as:
Did you mean pile up, ride up or rise up?