First off, to the forums!
Ah! The joys of older houses! I've lived in, and extensively remodeled (read, in many instances, "rebuilt") a house originally constructed in 1910 for the last twenty-six years. If you find a right angle, it wasn't originally!
What you need is a heat gun. You should be able to find one at a local hardware store. These are not hair dryers, but they look sort of like one on steroids. They blow a blast of very hot air out the nozzle, hot enough to burn things, including you. So watch where you point them! They often come with a scraper that can be attached to the nozzle, but I wouldn't bother with that—just use a stiff-bladed putty knife.
Because paint and caulk are polymeric, they soften when heated. Window glazing compound is the same. To remove the glass from the window, heat the glazing compound with the heat gun until it softens, then scrape it away. Once that is gone, you should find glazing points holding the glass in place. These are about 1/4 inch sized, either triangular or sometimes rectangular pieces of flat metal driven in parallel to the pane of glass. Pry them out by pushing sideways with a screwdriver. The glass can then be removed.
To remove the entire window panel, heat the paint/caulk and scrape it away. Then heat any caulk that was forced between the frame and the window panel, and rake it out with the putty knife and a piece of stiff wire. When you have gotten all that you can remove out, proceed to the next step.
If you discovered nails between the window panel and the frame, the best solution is to cut them by inserting a short-handled hacksaw (also at the hardware store, looks like a keyhole saw but with a metal-cutting blade) into the seam between the window panel and the frame.
Next you will need a woodworker's crowbar. It looks almost like an ordinary crowbar, but it's only about a foot long, 2 inches wide at the widest, and about 3/16 inch thick. Both ends have very thin tapers so they can be worked into thin seams and joints. Insert the crowbar into the space between window panel and frame. You may have to drive it in in places with a hammer or mallet. When fully inserted, pry firmly at intervals of no more than 2 inches until the frame comes loose and you can work it out gradually.
All that being said, don't be surprised if you break a pane of glass at some point. Old glass can get quite brittle and fragile. To replace, just proceed as first described. Wear gloves while handling broken glass! If the glass breaks, as part of your cleanup, wipe down the floor area below the window with a wet rag or bundle of paper towels to pick up the tiny splinters and fragments you can't see. If it is over carpet, you should put down a drop cloth before starting any work.
Good luck!