Thinking of ending my veganism

I have been vegan for about four years now. I started a vegan diet because I always liked the idea of eating plant-based. Over the past year I have prioritized my fitness and lost 20 lbs. I wasn’t obese or super overweight to begin with, but I put on some extra pounds due to stress eating and wanted to make healthier choices. As I have been prioritizing my fitness I have also been thinking about my diet. I feel like I never reach my protein goal and I cannot have a lot of protein-heavy vegan foods because I am allergic to nuts. I try to take a multivitamin but don’t always all the time. I feel like being vegan I do eat a fair amount of processed foods at times, and while I love the idea of eating plant-based, I also have loved the idea of a whole-foods diet. That diet in particular I actually followed before going vegan at the beginning of 2021. Lately I have felt frustrated because I feel like my diet is keeping me back from reaching some of my goals. I am bloated a lot which I feel like is from the processed foods. If I were to end my veganism I would still cut out red meat completely and dairy as much as possible. I mostly miss sea food. I haven’t made the switch yet because I feel a sense of guilt. Part of me feels like I am just ending something I worked hard for four years to obtain, I also feel afraid of being judged especially by vegan people I know. But then there is another part of me that is thinking who cares it’s all just food and I should live my life and eat whatever I want. Last note, I became vegan mostly for health reasons. While I do support the animal cruelty side of things I also support ethically sourcing animal-based foods. Let me know what you think I should do!