The past tense of put away for a rainy day is also put away for a rainy day.
The third-person singular simple present indicative form of put away for a rainy day is puts away for a rainy day.
The present participle of put away for a rainy day is putting away for a rainy day.
The past participle of put away for a rainy day is put away for a rainy day.