PC problems

I need some help. In the paragraph below I refer to “Muslim prayer pajamas”. This is the best description I can think of for the outfits the individuals were wearing. But is it PC? Or is it offensive? I had changed it to “Muslim prayer outfits” but it just doesn’t have the same ring or descriptive aspects of the phrase in question.

Any thoughts would be greatly appreciated.

A crowd gathered. Men in full-length Muslim prayer pajamas wearing flat-topped Muslim caps stopped. Businessmen who look like businessmen everywhere except sweatier and dustier stopped. The traffic cop came over from his station in the middle of the intersection.