You are missing the point. With cold/hot, you are being prohibited from exploring the map until you do SOMETHING to get around the issue. The very same game that lets you go straight to the final boss from near the start of the game... doesn't let you scale a mountain because it's too cold? Unless you eat specific foods or wear specific clothes? It's just another of many small annoyances in the game that I just have a hard time understanding the reasoning behind.
You'd also be able to play the entire game just fine with a dexterity system, which, like the hearts/stamina system, could be ignored if you want. Not prohibitive in the slightest, certainly no more than "find the right food/tunic to brave this cold temperature."
I'm trying to find a system that can make weapons feel earned again. You beat a dungeon, and oh shit, now there's a bunch of new weapons to use, learn and experiment with. Each weapon has their own unique quirks and differences, which encourages you to use them, instead of having them be nothing more than disposable crap you keep cycling through. You might have a 1 handed level 1 sword, but now you found a 2 handed level 2 sword. Even if you prefer the 1 handed sword, do you really want to trek foward with the weaker weapon, or learn a new style of combat with the more powerful weapon? Or keep exploring until you find that 1 handed level 2 sword? It's entirely up to you! Now that part of the map overrun with OP enemies is a little more tolerable. A sense of progression and difficulty curve, while still leaving the game entirely open and free to explore. No raiding Ganon's castle at the beginning of the game, grabbing a bunch of 50+ weapons and wrecking bosses with those.