"To wear a sweater" means to put on a knitted piece of clothing that covers your upper body to keep you warm.