Don't know about the industry in the US, but here in Oz, it's a rather difficult field to get into. Rushed deadlines, difficult clients, communication breakdowns, outstanding accounts, lots of work for little compensation........yes, it's probably worth it to be able to get paid to do something you love to do.
I've been very lucky in that I have a number of clients that I build models for that have kept me in constant work for many years.......doesn't pay as well as you'd think - in truth, they'll NEVER be able to pay me for my time as well as the model.
All I can suggest is to make several models of unusual structures, and then take the models (as wella s some of your built model kits) around to the various companies that make architectural models.
Good luck.