You have tension on that axle, it's acting like a spring. I think dustyroller is on to something there.
If it's binding up going forward then releasing when you reverse, something is locking up.
You'll have to work backwards until you find it (remove wheels, remove axle housing, etc)