I'd wait a few minutes for the owner to show up before continuing my way.
People are really nice where I live. One time I accidentally dropped my wallet and 15 minutes later, when I finally had noticed my error and rushed back to the scene, a lady was there waiting for me.
Living in......a society! ;_;