Does PA Dutch trace back to German?

Yes, it is a German dialect. It's similar to Platt Deutsch, which is spoken in some parts of Germany. It's called Pennsylvania "Dutch" because the original settler's reference to themselves and their language as PA Deutsch (PA German) was mis-heard by others as PA Dutch.