I am one who always primes PE with a good metal primer. I use a spray can (Krylon primer). I prime the whole fret at once. If most of the parts will be a single color, as in many ship PE fittings, I then airbrush that color over the whole fret. Then I brush paint any that are a different color. With flat paints the PE parts are very small and do not show brush marks. Even with gloss paint a very small PE part doesn't show brush marks with careful painting. It is unusual I must resort to airbrush for single PE parts.
BTW, even with a good metal primer I find paint adhesion to brass is not that great. If you have to bend any PE parts the bending frequently chips off paint. However, it is easy enough to touch the small chip areas.