Yeah, it's not like you just walk in, pressed the code and left. Most launch facilities were underground and HEAVILY fortified. And even then, there would be a number of officers and servicemen present. And there is also deactivation codes and timing delays as well. Makes for interesting science fiction and a story though. Imagine if some James Bond type spy actually could get through it all and could guess the code.