The phrase "to watch the boats" means to observe or look at the boats as they sail or float by on water.