it simply means "well built".
I've never seen a brick [out]house, and I don't see anything that would suggest that they would necessarily be well built.

Perhaps the simile is more easily comprehensible if "well built" is rephrased as "built substantially beyond the norm".