Twisted? How is someone being with a blind or deaf twisted?
I don't suppose it is.
Probably twisted if the person is only interested in people with these features for purely sexual purposes. As a fetish.
Not even that, really. It's not a power thing. I guess if I would have to define it, it would be about being with someone with a completely alien perspective of the world from mine. I find that extremely attractive for some reason.
I also fantasize that I'm Alfred Pennyworth and I take care of Batman. Not in a sexual way, but that I care so very much about him.