The phrase "to warm the milk" means to make cold milk a little bit hotter, usually by heating it up gently.