After sanding defects out of primer

Foxy, I second Bill's advice, especially over just proceeding to apply your color coat over that spot.  Better to have primer down, than not, in my experience.  And it's certainly possible and easy enough to re-prime that spot, than to do the whole piece over.

I'd probably spot prime it. Try a couple of ways to see what works.

Bill