Yes it makes the latter completely warranted and right.
What are you even saying? I'll use my previous example again: voting for a racist is the same as telling people, "I'm fine with racism." These are the same things. The fact that you're simply avoiding the latter by doing the former doesn't change that.
And it can be applied to voting to screw poor people, make healthcare and education a privilege, treat Climate Change as a farce, give tax cuts to the rich, reduce access to abortions, etc.
That's not just a political difference; that's a fundamental difference in the way you view life and value other human beings and the world. And they're not just differences in opinion about how to make things better. Some things are demonstrably wrong, morally corrupt, ineffective, useless and downright evil; other things are demonstrably the opposite. If someone is voting for the former, how the hell is it NOT right to judge them based on that?