You have to
prepare for those eventualities when something does go wrong and
make sure that the recovery from problems
is as unpainful as possible; and do a lot things to prevent total catastrophe, where it
's stuff that maybe you can roll back from or only hurts a small subset of users because things
are ultimately going to go wrong, there
are bugs in all software,» said McCaleb.