I understand what you're saying, and that's why I have invested in a dedicated spray booth as well as an ultrasonic cleaner. Here's my clean up rituals:
when I am spraying one color after another -- gravity fed brushes
-- dilute remainder of color, pour out. Dip the brush in a small bucket of water I keep near my booth. Spray color cup of water/Windex, "backwash", I may spin off the chuck and wipe off the needle if I'm going to be spraying drastically different colors. Similar colors, not as big of deal.
time: 2-3 minutes max. If I want to only spray a couple of colors, I usually have a couple of brushes primed and ready.
when I'm spraying one color after another -- side feed
-- pretty much the same, except I tipped the brush on its side, and use my squeeze applicators directly in the brush itself. time is actually faster with this type of brush.
when I cleaning up for short time -- taking a break
-- pretty much the same process, except a more thorough cleaning of the cup, disassemble the brush, wipe down the needle in the interior. If I've been spraying for a long time, I might spin the nozzle off and clean it out (iwata's have pretty small nozzles, so I don't do this all the time)
time: 5-10 minutes
when I'm going to hack things up, or periodic deep cleaning of my brushes
-- I use an ultrasonic cleaner. The kind you use for jewelry. Handy to get old crap off your brush. I disassemble it, put it in, run it through. Use some lacquer thinner for anything caked on. Thoroughly clean the nozzle.
time: 15 plus minutes per brush easy. I don't do this one a lot, or try to avoid it. I'd rather be spraying!
as foreign extractor, have you thought of just putting a fan in front of your open window?