I had learned that Mistress and Master were for young or unmarried people and Madam (Ma'am) and Mister for older or married people. Esquire after the man's name to indicate a property owner (old, now) or a law degree.
I think there are many regional uses of these terms that have changed over the years.
I still remember when we moved to the South and my mom called someone to ask about buying a crib. The lady she spoke to was horrified, as a crib is a whorehouse. She should have asked for a 'baby bed'. *lol*

~===,===,=^=<