The phrase
"long spoon" means you should be cautious about who you spend time with, or be careful about the company you keep. It implies that it's better to keep a safe distance from people who might have bad intentions or influence in order to protect yourself.
Full definition