I feel like removing the timers would ruin the point of this game... It would be like removing the cooldowns in a MOBA (well, there's URF mode for that in LoL and i hella fun but definitely not balanced). You're supposed to punish someone who has something on CD. For him, it'd be like playing Starcraft and nothing has build times. Tell him to do something else while things are on CD or just play more passively.
The problem is really easily solved. Simply offer both cooldown and no cooldown modes and let the market decide.