Hey anime/manga fans....does it suck if it's popular?

No, and actually I personally believe that anyone who would abandon an amazing series just because it has gained popularity is an idiot. If the series hasn't changed then there is now reason to like it less just because more people have started to like it. If you don't like a fandom for a series then just stay away from it, don't let it ruin a good series for you.