Replaced the battery but when I go to start the fuses blow

The main fuse blew. Look in your fuse box for a big fuse it should be labeled main or master fuse. Replace this fuse and vehicle should work everything but maybe the starting issues. You have a short somewhere. If the fuse blows again or the car won't start repost the problem

I would say there is a short somewhere. You can get a resetable fuse.

ok first there could be a direct short in the ecu causing the fuse to blow OR the alternator/starter solenoid could be shorting out and blowing the fuse unhook the alternator and see if it blows the fuse then repeat with the starter and the ecu and let me know what happens

Replace the signal Relay thats your problem.

check fuel filter to see if its clogged. (cheapest easiest)
if that doesnt work rebuild carburetor (expensive but fairly simple)
if that doesnt work pull tank if it is low on gas or pull bed if gas tank is full a replace fuel pump (time consuming, hard to do, but fairly inexpensive) I had this problem on a silverado I had and it was the fuel pump.

The main fuse block located under the hood for the 1991 ford probe shows 13 fuses. There is a fuse that contros the heating, AC & Programmed ride control system. It is a 40 amp fuse and has a blue wire.the color code for a 40 amp fuse is green.

to ensure good connections, yes but you still should be able to plug the new fuse in until you get the box relpaced

You might have better luck looking for 'relay box' as I had a number of hits on that phrase:
http://www.google.com/search?rlz=1C1GGLS_en-USUS291&sourceid=chrome&ie=UTF-8&q=1991+ford+probe+"relay+box"

If you can find a replacement, you might want to pull fuses and relays and coat them with either dielectric grease or at least petroleum jelly (Vasoline) to protect them. Fuse/relay boxes next to the battery have a hard life because of the fumes from it and once the contacts start to corrode, a meltdown is a lot more likely.  

sounds like you got a short try tracing harness to see if theres anything visible