It depends though. There are probably a lot of people that just disappear and are never found and then get reported as drownings. The ones we hear about are the ones where somebody was there to rescue the guy before he was completely devoured or somebody witnessed the situation. You don't hear about the guy that's gone. Nobody knows what happened to him, so it doesn't get reported as a shark attack. It would probably inflate the numbers a tiny bit if those were listed.
There are also the ship disasters, where we know that sharks have killed and eaten countless people waiting for rescue. In many cases, you can never be absolutely sure about those sorts of attacks and they don't get counted either, but we know from a few cases that are well documented that eventually the sharks do show up and eventually they do start killing people.
I think the reality of the danger from sharks is probably a little worse than shark apologists would like us to believe, but not as bad as popular culture would like us to believe. The ocean is theirs and the easiest way to avoid danger from them is to just stay out of it. That's what I do. My phobia is more than enough incentive.