Okay, my 03 Durango is fixed, it for sure was the red wire, well not the wire but the connector on the control panel where the red wire plugged into, it had a bad connection, I had ordered on Ebay a replacement window control panel, once I replaced it, it all works now, before I replaced it, I could close the driver door or just jiggle the red wire and all the other windows would quit working, then I would just jiggle the red wire again and they'd start working again. I replaced the control panel and everything works correctly now, so mine wasn't the wire but the connector itself on the control panel, hopefully this helps somebody.
Thanks

 

deleted