AHD4 lists the Latin as both umor and humor. The H was gone in the Old French we stole it from so maybe it just got added in the same way as the B in doubt/i] and [i]debt or the C in perfect.