Yes, «We just want him gone», but «We also want the violent racist
homophobic xenophobes he attracted to still vote for us».
He's been painted as a misogynist, racist,
xenophobe,
homophobic, etc. and it's obviously unpopular to support someone who is (or at least appears to be).