As you say, it doesn't really pluralise very easily. A quick look at Google suggests that pandemoniums is usually an error for pandemonium's.

The word was coined (sounds so much nicer than made up, doesn't it?) by Milton as the name of the city of all demons in his description of Hell in Paradise Lost.

Bingley

Bingley