I asked Bingley about this, and he said about the same thing as you did, insel: that without has pretty much come to mean 'not accompanied by'; which I knew, of course, but.
It would be so nice and logical, wouldn't it, if without you was the opposite of within you? Dag nab changes, anyway [only half-joking e]; anybody know when this one took place?