Another note on primers: For a given paint type (enamel or acrylic) primers are generally formulated to dry and cure as quickly as possible, for obvious reasons.
Like Bill, I generally do a "field cleaning" every time I empty the cup, whether changing colors or not.