How can you tell who wants to play Gwent? So far I've only found the tutorial guy in the first inn and the guy in Vizima (because there was an exclamation mark).
I think all the merchants in Velen map play. It's a dialogue option so you just have to talk to people.