You are right. Diminishing returns, unfortunately.
In fact probably it will be one of the biggest leaps in the console history.
I think the 4 factor increase in resolution is probably the biggest ever, isn't it? That's got a lot to do with why the leap isn't as impressive as some of the others.
I won't say not impressive, because it still looks a big leap to me even discounting the 4k.