5th Gear Popping Out of Gear

I have a 97 GS and when I shift into 5th its okay, but when I give it any gas to accelerate/try to make it up a hill/ or anything that involves more throttle it pops out of place, and I have to hold it in if I want it to stay while accelerating in 5th. What could be causing this? Thanks!