to address another man as ‘son’ is really to call into question the addressee’s masculinity
I would say it calls into question maturity and status rather than masculinity since younger generations generally have less authority. Son implies expected obedience to the "father."