So I had another day of fiddling, and interestingly enough, after my frame rates mysteriously dropped and started stuttering one day. I finally have managed to fix it.
I tried a couple things:
Matching my desktop resolution to the game. Previously my desktop on my 4k TV was on 4096x2160, I changed it to the game resolution of 2560x1440 before running the game.
Verified the integrity of the game cache, (Right click and hit repair on the game). It didn't appear as though it had any problems, but it did say it was "installing" at one point. But of course that could be Origin being jank.
Enabled AMD's FRTC to 30 fps. (However in game i still have V-sync on because unfortunately i'm limited to 30hz due to not having the proper set up on my rig)
Dropped mostly everything to high, but still kept Lighting, Texture Filtering, and Texture Quality on ultra. (There is no resolution scaling turned on, i'm in fullscreen and no triple buffering)
All that on top of defraggin the hard drive as well, I managed to get rid of the stutter. I'm not sure WHAT was the culprit, but i'll update in a bit, i'm very carefully ramping settings back up to ultra to see if anything triggers it again.
Thought it could prove useful for anyone else having this issue.