In Brazil, it's called castanha do Pará, after the Amazon-region state where the trees are most prevalent.

Here's a link on how Brazil nuts are harvested:

http://www.amazonconservation.org/home/brazilnuts.html

And yes, I also freeze all my nuts, unshelled, slivered or whatever.