You can have capitalism and still have regulations in place. That's like saying you can't have socialist policies in place without going full commies.
In order to see the flaw in your reasoning, apply the same logic to free speech. You can’t say you believe in free speech BUT wouldn’t mind government controlling some type of speech. It means you’re pretty much a leftist and your main difference with a leftist is where the government line should be drawn, in other words, you’re a hypocrite. As for me, I don’t want any government line whatsoever be it in free speech or free market.