I don't know if it is the same for everybody but when referring to the relatives of my ex husband (a folly of youth) I usually say "the sister of my ex" or "my ex's mom." This leaves no room for ambiguity.