I have also heard, "to make an honest man of him," used to a woman when she has announced that she is about to marry.

Ah, yes. Marrying the man will legally commit him to provide for the offspring. Unlike his dishonest abandonment (knowing or unknowing) of his earlier wild oats. Thus, he's forced to be honest to his obligations.