You can hyphenate a word ending in ly:

(In the spirit of baseball) fly-by-night

Rimshot !!!

Boasting regards,
Wordwright