The phrase "small circle" generally refers to a close-knit or exclusive group of people who are interconnected or share common interests or values.