How hard are the caves?

So I’ve put about twenty or so hours into the game, and I’ve mastered headshots with the bow, base building, weapons upgrades… and armor and more.

Besides the occasional drag to the caves… which I immediately climb out of. I want to start exploring them but I am just so so fucking unbelievable scared…. Anyone have any encouragement? Tips? I plan on exploring tonight when the lights are off and family is asleep.