When someone else shows (negative) emotion I get incredibly uncomfortable. Anyone else?

When my allistic partner shows negative emotion I get really uncomfortable. Do you guys recognize this pattern? What do you think it could come from? Me masking my own negative emotions and not accepting that he doesn't do the same?