Notice that pyjama in pyjama party or pyjama top is being used as an adjective to describe the party or top, rather than as a noun in its own right. Adjectives in English not having singular and plural forms, the s is dropped.

As to whether its etymon had an s or not, perhaps Avy can help.

Bingley

Bingley