I've done that technique using Krylon sandable primer in the big spray can. I'll spray it into a container that I can then either paint brush from, or pour into my airbrush and spray onto larger areas. I've found it to be a very good seam sealer for those tiny cracks that only show up after a coat of paint or primer.
My biggest concern about doing this is knowing whether the "filler" paint is fully cured and will no longer shrink.
When you say "fast drying", do you mean dry to the touch? Most paints that dry quickly "to the touch" still have a period of curing in which they continue to evaporate the carrier solvents, and the paint continues to shrink until fully cured. Shrinking isn't bad on surface areas (it's more like a thinning out process of the paint layer), but when used to fill a crack, it will seem ok at first, but that crack may re-develope as the paint solvents evaporate. I've sanded many seams that looked great, but when the final paint was applied, there's that pesky crack again, only a little smaller.
The Krylon that I use is fairly hot, in that it's solvents evaporate quickly, as do most primers. What is the solvent base of the paint you are using? Is it an enamel, lacquer, or is it water based? Lacquers are usually hotter and have a faster cure time. Enamels are slower to cure, and water based depends on the humidity at the time.
stinger