The phrase "don't throw out the baby with the bathwater" means not to discard something valuable along with something that is worthless. It refers to a time when people used to give birth in a tub filled with hot water (a "bath"). After the baby was born, the water would be dirty and so they would throw it all out - including the newborn! The phrase warns against throwing away the good along with the bad or unnecessary.