I think my problem with Voyager isn't so much that it's really bad. But my problems is that when compared to DS9 it's problems and quality are really magnified.
In DS9 you have a ton of memorable characters. Have your opinions on Jadzia Dax or Bashir but Odo, Quark, Nog, Garak, Dukat, Jake (in some episodes), Martok, Sisko and even O'Brien all had really good moments and episodes. Kira was underused a lot as well but she also had some good episodes too. Compare that with Voyager that had maybe...three characters that were consistently good (Seven of Nine, the Doctor and Janeway) and very little development for other characters, it really showed how under-utilized everything was. A lot of Voyager's friendships or relationships in comparison to just the O'Brien-Bashir friendship felt rushed and forced. Beyond the Doctor there was no sense of a playful back and forth conversation like Odo and Quark or Garak and... well anyone else.
So I think you're right, over-hated it might be. But I think it's fair to be very disappointed in how it came out when compared to everything else.