There are different ways to perform facial recognition, but generally the accuracy
of it depends on factors such as the quality
of the
image of your
face at authentication time, light conditions, time between the
enrollment image and verification, and visibility
of occluding objects like a scarf or sunglasses.
Here's where there's a difference between Touch ID and
Face ID: Touch ID threw away the original
enrollment images of your fingerprint at this point.