I don't know if that's orange peel - sounds more like dusting (air turbulence causing paint particles to dry erratically, leaving that rough, gritty surface) to me.
As the others have said, wet sanding with a fine grit paper should knock it down no problem.
In the future, you may want to try soaking the rattlecan in warm water before you spray it, or decant and airbrush.
I've been playing with primers ever since I got back into modeling last summer, and I keep coming back to Model Master primer (in the bottle). Seems to give me the most consistent finish, and I have yet to have problems with paint lift that I've experienced with a few others.
On the Bench: 1/32 Trumpeter P-47 | 1/32 Hasegawa Bf 109G | 1/144 Eduard MiG-21MF x2
On Deck: 1/350 HMS Dreadnought
Blog/Completed Builds: doogsmodels.com