I suppose it wasn't really an issue until they invented the lift (elevator) - I can imagine someone calling out in frustration, "So what letters do you want me to put on the buttons then!".