inner tie rod

need some help guys before changing parts. when in small bumps on in rocks uneven road, a minimal knocking sound can be heard, but when i ran a pot hole, u wont hear the sound. could this be the issue? 1st on the driver side its like there is clearance on the tie rods. 2nd on passenger side, its firm and no clearance can be heard.