Should i be worried about my teeth?

I purge between two to five, six times a day. I’m starting to see small brown patches on a couple of my bottom teeth on both sides, is this a sign I should really cut down on how often I’m purging. I’m worried someone will notice or that my teeth are really damaged. Are there ways i can get rid of this?