This is partly due to negativism, a hallmark of toddlerhood, and partly due to lingering separation anxiety — he can still feeluneasy when you're out of sight.
You can make your date feeluneasy if you're looking everywhere in the room but at him or her, or you can signal your attraction to your date with a lingering gaze.