Only thing I can add, and this is making me feel old, I remember talking about watching anime on Cartoon Network/Adult Swim, and my friends in school were surprised I was allowed to watch TV that late. Think they were on around 9 or 10PM usually (Outlaw Star, Tenchi Muyo, Gundam Wing, G Gundam...)

I think it really depends on the people you surround with, and as others have said, just because those in high school make fun of you, there's a big audience of anime lovers. Whether audience, artists, voice actors, animators, etc., if you ever get a chance to, I encourage you to try and go to an anime convention if you never have been to one. It's a big, eye-opening moment for someone who hasn't had the chance to experience a moment where everyone is celebrating their love and appreciation for anime.