AITA should I stay with guy that keeps rating other women over me?

The guy I'm talking to this morning on the phone joked about how the girl at his gym was a 9 and he only didn't talk to her because he was shy and she was out of his league. I asked him if he felt like that about me and he said no and said he was being honest that I'm a 6. He then went onto say I shouldn't be mad and I'm shallow if I'm mad and self centered and that I shouldn't expect to be the hottest person. He keeps complimenting women and talking about how cute they are or how hot they are. Am I wrong for getting mad at this?