The phrase
"smaller brains" refers to the physical size of someone's brain being smaller than usual. It usually suggests that the person might not possess as much intelligence or have a harder time processing information compared to others with larger brains.
Full definition