If I'm hand painting small plastic parts, I do not prime. Any large parts or assemblies get primed before painting. All metal and resin parts need primer. I use Gunze Mr Metal Primer on hand painted metal parts, and Tamiya lacquer primer in a bottle for hand painted resin parts.
To help ensure paint adhesion, you should wash the parts in an unscented dish soap that contains no hand lotion. I use Ivory. This is to remove any mold release, hand oils, etc. that could be on the parts.
I don't generaly wash metal parts and never wash photoetch. Not a rust issue. I actually don't have a good reason why. :-) I just haven't and haven't had any issues.
Mike