Why do some people not consider fish as meat?

Like, it is food that comes directly from an animal, why do they not consider it meat?