As a grad student in a Speech Language Pathology program, that's gonna be a no from me.
This is a really poor attitude to have if you're planning on being an SLP. Much of your work revolves around phonology, phonetics, and audiology which are all quite math heavy at the underlying level. Yea, you can bullshit your way through a lot but I'd be quite concerned to find an SLP that was unable to at least know the association between a logarithm and hearing, what resonance is and how it is associated with speech production, how to track/graph their own data, how to determine if their patient's therapy gains are significant or not (and if so, how significant), how to read research articles, how design your own therapy techniques and be able to test them to know if they are effective or not, etc. etc.
Here's another really important one you should learn to appreciate NOW because you can and will kill someone in a hospital setting if you at least don't appreciate this:
In short, never ever ever endoscope a patient with a sky high INR level (like someone on too much Coumadin) as just a slight scratch in the nasal cavity/nasal turbinates/etc. with the tip of the endoscope can cause a massive hemorrhage.
This profession isn't just "English class but teaching it really really well". It's applied linguistics with some medicine all of which are quite math/logic heavy. Any decent physician will tell you they are a scientist first and foremost and you need to have the same attitude as well to actually make a positive impact in the lives of your patients.
This doesn't mean having the ability to factor polynomials in your head under 20 seconds, but at least having the ability to know where to look to remember how, and to be able to do so efficiently. It's impossible to do such a task efficiently without at least some kind of previous exposure.
Besides, lets say you plan on being a speech path in the school setting. A lot of kids are going to be coming to you stressed as fuck about their math homework or whatever and won't be motivated to work on their speech/language exercises that day. There exists an opportunity to kill 2 birds with 1 stone IF you know how to help them with their algebra homework. It's a near-perfect incentive to do a few therapy tasks in exchange for help on 1 problem. Depending on the speech/language disorder/severity of disorder/etc., you could even potentially figure out a way to blend speech/language therapy with math problem practice essentially making the therapy quite naturalistic instead of just rote.