The past tense of fly by is flew by.
The third-person singular simple present indicative form of fly by is flies by.
The present participle of fly by is flying by.
The past participle of fly by is flown by.
