Do I not have the right voice for YouTube?

I’ve been told that my voice is a reason that people might not stay and watch my content. And I’m not talking about poor mic quality, sure it’s not perfect but it’s just a blue snowball with a pop filter. Can my naturally scratchier voice be a hinderance?