where all did you go

where did you all go?

Means two different things.

Not when Helen and her ilk say it. No Noo Yawker is gonna say "you all" in the sense us Southerners do, Mr Faldage.

Is "all" an adverb here? I'm a little confused but I understand what Helen meant. Just can't convey it.