Removing food often does not result in cats simply moving out to look for other food sources if other attractants (dry shelter, a male cat drawn to females in heat, a frightened tame cat comforted by the presence of humans, etc.) are strong.
It may also allow a frightened tame cat to settle down and reveal his true colors — tame cats may turn out to have owners or be adoptable, so recognizing them is important.