It has some low res textures as anything has from that era, but I still find the Banjo games to be pleasing to look at.
Most of their charm comes from the good animation on everything and the stylized models of everything. Tick Tock Woods with it's massive central tree is still pretty impressive as well as how the entire aesthetic of the level changes as you change the seasons. Even the enemies will dress differently.
Clanker's Cavern was also a really cool, great looking level, especially how Clanker actually moves and breaths:
It's all very subjective, though I'll admit. Games like Metal Gear Solid are very impressive to see knowing they were made back on the PS1, but the textures (especially on people) are so bad and it has all the built in PS1 polygonal limitations. However I still find it to be pretty impressive when you account for the era it was made. Maybe not as "timeless" looking as Super Metroid or stuff like that, but still impressive.
I still like how Final Fantasy 7 looks, LEGO mini-fig character models and all.