If you use a primer, give it sand with some very fine grade sand paper. If you don't, sand the plastic anyway. Before painting, give the model a wash with some soapy water (This will get rid of any oils that could affect the paint). Let it air dry. Before you paint, give the model a going over with some air from your compressor (To get rid of any dust). Then paint.
Once it's all dry, decal and all that stuff, then spray your gloss clear (or matte if you want). Like MusicCity said, you'll get a much better finish with a clear coat (There is no pigment to leave a rough finish). Microscale Micro gloss does the job for me. Polish it with something like Tamiya compound, or very fine sanding cloths (like micromesh). That should bring up a nicely glossy finish.
Hope this helps.