At this point I don't know if you're ignoring the responses you got, failing to understand them or being deliberately obtuse. Never mind, I'll bite:
The ones who used the blocklist don't want any contact with someone who is a potential harasser or asshole. It's the old "better safe than sorry", they are taking preemptive measures to avoid any possible trouble in the future. It's also a way of cutting down the noise from people or groups they don't want to listen to, and after all the shit GG did (as a group or as individual members, I don't care) I can't help but agree.
The whitelist is exactly what you described. You make it sound like a bad thing, but it's not. It's not your call who @UserX hears from, it's theirs and theirs alone. They don't owe you a mic to speak to them. The whitelist is an admission of the blocklist not being perfect (no system is), and a tool to solve any mistakes that may have happened (aka false positives) because as you said, not every asshole follower is an asshole themselves. Though I seriously question the morals of someone who follows the biggest assholes involved in this horrible mess. And I'm not the only one, thus the creation of said lists. Don't like it? Easy: don't associate with those people. Want to exercise your right to do it? Then you'll have to tolerate the fact that someone is going to judge you for the ones you hang out with, and worry that you may be just like them.
I still can't believe we're having this argument because some stranger you probably didn't even know existed blocked you on Twitter. Like, it blows my mind so hard.