So, I adjusted the nuts on the crossfeed handle, it needed a little, but not much. What I did do that seems to have fixed the problem is to tighten the gibs on the compound so it can't move. That seems to have solved the issue. One of the biggest frustrations with these old lathes is getting the gibs adjusted. They all seem to be worn enough to make it challenging. Thanks for everyone's help!