extremely plausible...moreso than the vision of multitudes hauling this huge tonnage vast distances

Scuse me? Hate to break in on this fascinating discussion, but a small particle of elementary physics still applies in these crackpot alternate universes: mortar/concrete = solids + water + evaporation. Therefore any fabricated or cast blockwork mass will have entailed bringing a greater initial mass to the construction site, not a lesser!