Bashi Bazook, not Banzai Bazook.
Edit: And on the note of Bashi Bazook... what about Xexyz? Great game!
It does have a level structure, with shmup parts between the levels, and you do mostly go right, but you also have to backtrack, find stuff, etc... and you have money, items to buy, etc.