Front dome light and overhead driver and passenger lights don't work

Front Flasher is separate from the rear at the firewall connector. Find out if you have good front flasher bulb and with a test light if there is a good + and - for the front flasher.
Now, for the blown fuse. I suspect there is a bad ground and the dome light and the flasher lights share the same ground.
Explaining: If it is when you turn on the right flasher(This is the bad ground circuit. The right flasher will take a shortcut to the dome light and probably the dome fuse is rated low. That will blow the dome fuse (Overcharge on the dome fuse). Could be why the front signals don't work at all. (Flasher ground problem).
Hope it helps.

Beings as everything that stopped working is on the passenger side, I'd think some wiring got disconnected or broken.

it sounds like a broken wire in the passenger door.

where is the power window fuse located?

Instrument Panel Fuse Block
The instrument panel fuse block access door is
located on the driver side edge of the instrument panel.

Pull off the cover to access the fuse block.

The vehicle may not use all of the fuses shown.

Fuses Usage
1 Rear Seats
2 Rear Accessory Power Outlet
3 Steering Wheel Controls Back light
4 Driver Door Module
5 Dome Lamps, Driver Side Turn Signal
6 Driver Side Turn Signal, Stop lamp
7 Instrument Panel Back Lighting
8 Passenger Side Turn Signal, Stop lamp
9 Passenger Door Module, Driver Unlock
10 Power Door Lock 2 (Unlock Feature)
11 Power Door Lock 2 (Lock Feature)
12 Stop lamps, Centre High Mounted Stop lamp
13 Rear Climate Controls
14 Power Mirror
15 Body Control Module (BCM)
16 Accessory Power Outlets
17 Interior Lamps
18 Power Door Lock 1 (Unlock Feature)
19 Rear Seat Entertainment
20 Ultrasonic Rear Parking Assist, Power Liftgate
21 Power Door Lock 1 (Lock Feature)
22 Driver Information Centre (DIC)
23 Rear Wiper
24 Cooled Seats
25 Driver Seat Module, Remote Key less Entry System
26 Driver Power Door Lock (Unlock Feature)

make sure the dome light is not turned off by the switch headlight of switch at the dome light.the fuse panel should be under the driver`s side to the left of the steering colume and use a test light to test the fuses.

The dome lamp has a switch that can be put into several positions. "Door" "Off" and "On" If you want the light to come on when you open the door then you must have the switch in the "Door" position.
The "Off" position will only let the dome lamp work when you override it with the dash control and the "On" position will leave the light on at all times - door open or not.

Hope this helps:- Factory Disarm Purple/Yellow (-) Driver's Kick Panel Black Connector at ECM -slice into this wire, & wire it to ground, this disables the alarm.
Cavity/Fuse Diagram (1996 Grand Cherokee, passenger side kick plate to find, Owner's Manual pgs 205-206): 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22

Row 1: 1-6 (left to right) Row 2: 7-12 Row 3: 13-18 Row 4: 19-22
1996 Jeep Grand Cherokee Fuse Panel (Passenger Side kick panel) Reply

CAVITY FUSE DESCRIPTION 1 -10 amp (RED) Radio 2 -15 amp (Lt Blue) Cigarette Lighter 3 -10 amp (RED) Rear Washer Switch, Body Controller 4 -10 amp (RED) Airbag 5 -10 amp (RED) Lamp Out Module, Overdrive Switch, OBD II 6 -15 amp (Lt Blue) Vehicle Information Center/Graphic Display Module Park & Side Lamps, Overhead Console Lighted Visor, Automatic Dimming Mirror 7 -20 amp (Yellow) Body Amp, Cluster, Body Controller 8 -20 amp (Yellow) Rear Wiper Motor, Flipper Glass Solenoid, Cargo Lamp, Trailer Tow 9 -15 amp (Lt Blue) Brake Switch 10- 10 amp (RED) Rear Window Defroster 11 -10 amp (RED) ABS Module 12 -10 amp (RED) Heater-Ventilation-A/C Control & Recirculation Motor 13 -15 amp (Lt Blue) Hazard Switch, Turn Signal Switch 14 -15 amp (Lt Blue) Spare 15 -15 amp (Lt Blue) Spare 16 -10 amp (RED) Right & Left Courtesy Lamp, Glove Box Lamp, Halo Lamp Cargo Lamp, Underhood Lamp, Dome/Read Lamp Right & Left Visor, Automatic Dimming Mirror 17 -15 amp (Lt Blue) Radio Illumination, Tail Lamp, Graphic Display Module, Park & Side Lamps, Headlamp Switch, Body Controller 18 -20 amp (Yellow) Spare 19 -15 amp (Lt Blue) Passing Light 20 -15 amp (Lt Blue) Radio, Heater-Ventilation-A/C, Vehicle Information Center 21 -15 amp (Lt Blue) Power Outlet 22 -10 amp (Blue) Airbag Module -------------------------------------------------------------------------------------
1996 Jeep Grand Cherokee Alarm, Remote Starter, Keyless Entry Wiring Information Constant 12V+ Pink/Black Ignition Switch Harness Starter Yellow Ignition Switch Harness Ignition Dark Blue/Gray Ignition Switch Harness Ignition 2 Red/Black Ignition Switch Harness (for AC) Accessory Black/Orange Ignition Switch Harness Tach Gray/White Coil Brake Switch White/Tan Brake Switch Trunk Pin n/a Works with Dome Light Parking Lights Blue/Red (+) Left of Steering Column or Light Switch Head Lamp Tan/Black Light Switch Factory Disarm Purple/Yellow (-) Driver's Kick Panel Black Connector at ECM -slice into this wire, & wire it to ground, this disables the alarm. Door Trigger Yellow (-) Driver's Kick Panel see notes Door Lock 5/Wire in Driver's Inside Driver's Door Orange/Purple Lock Pink/Black Unlock Door Unlock and Passenger's Doors Inside Passenger's Door Black/White L Pink/Black Unlock Horn Wire Gray/Orange (-) Steering Column Windows Up LF=Light Blue, RF=Brown/White, LR=Blue/White, RR=Gray/Black Doors Windows Down LF=White, RF=Purple/White, LR=Red/Black, RR=Green/White
• Cruise Control Information • Stereo Information • View all Jeep Vehicles

Hope this helps:
Cavity/Fuse Diagram (1996 Grand Cherokee, passenger side kick plate to find, Owner's Manual pgs 205-206): 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22

Row 1: 1-6 (left to right) Row 2: 7-12 Row 3: 13-18 Row 4: 19-22
1996 Jeep Grand Cherokee Fuse Panel (Passenger Side kick panel) Reply

CAVITY FUSE DESCRIPTION 1 -10 amp (RED) Radio 2 -15 amp (Lt Blue) Cigarette Lighter 3 -10 amp (RED) Rear Washer Switch, Body Controller 4 -10 amp (RED) Airbag 5 -10 amp (RED) Lamp Out Module, Overdrive Switch, OBD II 6 -15 amp (Lt Blue) Vehicle Information Center/Graphic Display Module Park & Side Lamps, Overhead Console Lighted Visor, Automatic Dimming Mirror 7 -20 amp (Yellow) Body Amp, Cluster, Body Controller 8 -20 amp (Yellow) Rear Wiper Motor, Flipper Glass Solenoid, Cargo Lamp, Trailer Tow 9 -15 amp (Lt Blue) Brake Switch 10- 10 amp (RED) Rear Window Defroster 11 -10 amp (RED) ABS Module 12 -10 amp (RED) Heater-Ventilation-A/C Control & Recirculation Motor 13 -15 amp (Lt Blue) Hazard Switch, Turn Signal Switch 14 -15 amp (Lt Blue) Spare 15 -15 amp (Lt Blue) Spare 16 -10 amp (RED) Right & Left Courtesy Lamp, Glove Box Lamp, Halo Lamp Cargo Lamp, Underhood Lamp, Dome/Read Lamp Right & Left Visor, Automatic Dimming Mirror 17 -15 amp (Lt Blue) Radio Illumination, Tail Lamp, Graphic Display Module, Park & Side Lamps, Headlamp Switch, Body Controller 18 -20 amp (Yellow) Spare 19 -15 amp (Lt Blue) Passing Light 20 -15 amp (Lt Blue) Radio, Heater-Ventilation-A/C, Vehicle Information Center 21 -15 amp (Lt Blue) Power Outlet 22 -10 amp (Blue) Airbag Module -------------------------------------------------------------------------------------
1996 Jeep Grand Cherokee Alarm, Remote Starter, Keyless Entry Wiring Information Constant 12V+ Pink/Black Ignition Switch Harness Starter Yellow Ignition Switch Harness Ignition Dark Blue/Gray Ignition Switch Harness Ignition 2 Red/Black Ignition Switch Harness (for AC) Accessory Black/Orange Ignition Switch Harness Tach Gray/White Coil Brake Switch White/Tan Brake Switch Trunk Pin n/a Works with Dome Light Parking Lights Blue/Red (+) Left of Steering Column or Light Switch Head Lamp Tan/Black Light Switch Factory Disarm Purple/Yellow (-) Driver's Kick Panel Black Connector at ECM Door Trigger Yellow (-) Driver's Kick Panel see notes Door Lock 5/Wire in Driver's Inside Driver's Door Orange/Purple Lock Pink/Black Unlock Door Unlock and Passenger's Doors Inside Passenger's Door Black/White L Pink/Black Unlock Horn Wire Gray/Orange (-) Steering Column Windows Up LF=Light Blue, RF=Brown/White, LR=Blue/White, RR=Gray/Black Doors Windows Down LF=White, RF=Purple/White, LR=Red/Black, RR=Green/White
• Cruise Control Information • Stereo Information • View all Jeep Vehicles

my 97 burban has a dome override button next to light switch that does the same things you discribed look for it and push it if you have one its labeled