The basic formula was topsails, jibs and driver/mizzen set. Courses furled, obviously, and all the lower staysails taken in, this basically to simplify handling, improve visibility from deck and reduce the risk of battle-damage and fire. Topgallants and the higher-up staysails set or not set depending on conditions and wind direction. The spritsail would most likely not be set, it is called the 'blind sail' in Germanic languages for a perfectly good reason as it blocks vision ahead from the deck quite effectively. One did not particularly want to have more speed in a fleet-battle than necessary to keep control of the ship, a walking-pace would do nicely and the less strain on the rigging the less chance of stuff coming down after meeting a cannonball, plus you have the extra sail "in reserve" in case of a mast being shot away or some other mishap. Topsails, mizzen and jib were generally enough for the purpose.
One more reason for furling the courses was that these were rather unhandy sails, and simply not appropriate for many points of sailing because one blanketed another or they affected the trim of the ship adversely. If you needed to make drastic changes in heading doing so with topsails alone was easier, quicker and needed fewer men for sail-handling during the operation.
Ships were very often operating in fleets. As such, the flagship would set the pace so to speak, other ships had to conform to her speed or the battle formation would unravel. This might mean setting more or less sail depending on the sailing qualities of the individual ship. The flagship might be under just topsails while another, with a foul bottom or just a less skilled seaman in command might have to set topgallants to keep up. A third ship might have to reef her topsails not to outsail the first one.
Of course, there are exceptions. At Trafalgar, the British ships basically went in with everything up to and including studdingsails set, wanting to close the enemy as fast as possible in very little wind. At Quiberon Bay, Hawke's British fleet was chasing the French fleet into very dirty waters in strong winds and are shown in paintings with fore-courses set - but not topgallants. (In strong wind the topgallants simply could not be set while the topsails and courses could). Similarly, some paintings from the seventeenth century (the Four days battle, for example) show fore-course set in fleet battle, again without topgallants. Generally speaking the main-course was less used than the fore-course, for a number of technical reasons (read John Harland's "Seamanship in the age of sail" book for an in-depth discussion) so it is the major sail you would least expect to see set in battle.
Single-ship actions were sometimes the result of a chase, in which case chaser and chasee would start the fighting with more sail set than would strictly be optimal for a fight.
So, as for battle-sail:
Main course - Very unlikely
Fore course - Unlikely, unless too windy for topgallants and you feel the need for speed
Mizzen - Yes
Topsails - Yes
Topgallants - Maybe, mostly depending on wind strength
Royals - Unlikely, unless very little wind
Jibs - Yes
Spritsail/sprit topsail - Unlikely, if the ship has jibs. If the ship has no jibs (ie 17th Century) then maybe, depending on wind direction.
Staysails - Maybe
Leesails - Very unlikely