panhandler is one of those slang things whose origin is uncertain, but there is some evidence that it comes from the spanish word for bread, pan, slang for money -- which, at a minimum, all ties together to make a nice coincidence. There seems to be no connection between this and panning for gold or the panhandle shape of several of the states (Idaho, Texas, Oklahoma).

http://members.aol.com/tsuwm/