I went to MSU and am originally from Biloxi. While in Starkville, you have to check out tailgating in the Junction. MSU fans are really friendly, so don't be surprised if they invite you into their tents for a chat and a snack. Stop by the Fountain for some MSU ice cream, and snag some MSU cheese, too, if you can. A fun place in town to eat is Bulldog Deli; this is sort of where McCallister's originated from. Little Dooey's is great for BBQ. Starkville is a small town, so be prepared for HUGE crowds if you try to eat at a restaurant. I would recommend parking on campus and just staying there. There isn't an equivalent of Northgate, and there are very few restaurants off campus that you could walk to (Bulldog Deli is an exception; you could walk there from campus). There are plenty of options to eat on campus.
I never liked the true bars in town, but I haven't been back since 08, so maybe there are new places that aren't dumps. Old Venice Pizza Co has great pizza, pasta, and calzones, and also used to have a pretty nice bar to hang out and have a few drinks. I'd go there, especially if you are over 21. Most of the bars just tend to attract underage drinkers anyway. The Grill (in the Cotton District) and the Veranda are also restaurants where you can just hang out and have a few drinks.
Biloxi is a 4-4.5 hour drive away, depending on where you are going in town. ProbabIy significantly longer with game day traffic. I hated that drive every single time I made it while I was in school and can't imagine trying to do it after a football game.
[This message has been edited by TXTransplant (edited 10/22/2012 9:11p).]