Try keeping them in and aroundworkouts as the sugars will be used by the empty system more rapidly preventing the conversion to fat which occurs otherwise.
It is a MUST though to closely monitor and manage how much sugar you consume daily because if you are on a workout program and are consistent for months and still don't see any movement around the midsection, check your sugar intake.