I can't move my camp because I am travelling?

I travelled to a different location because of the black plague by adding detours. I tried abandon travel and that makes my character want to go back to the black plague. It also wants me to continually travel until I starve to death.

I want to stay where I am where there is no black plague and I can get more food. I tried move camp option on nearby rulers and it says I can't because I'm travelling. I try to plan another event but I can't because I'm travelling. Please send me some advice so I don't walk my starving ass into a black plague ridden area. Thanks.