between you, me, and the gatepost

Another variant I've heard is "between you, me and these four walls". Works quite well.