I've always used both, but I guess I've always used back and forth more amongst friends and to and fro in writing and poetry.
Interesting point!