If you have been exercising and eating properly for weeks at a time, there is nothing wrong with an occasional slice of cake or indulging in an extra serving of holiday dinner.
I won't say that some dairy hasn't snuck in during the occasional meal out or at the occasional wedding / birthday party when cake is served, but I haven't a slice or even a piece of actual beef, chicken, turkey, or fish since I started.