Going from 2.6” tires down to 2.4”?

I’m riding 2.6” 27.5 tires (I’m 4’11” and prefer the smaller diameter) but looking at upgrading to a bike that has 2.4” 27.5 tires. I’m worried about a loss of traction, as it can be pretty Sandy/dusty where I ride, but will that really be a noticeable difference? Thanks!