Losing fat requires your calories to be lower than you'd like at certain times, that's pretty much a given. There's loads of ways to try and soften this blow; cardio, use of sweeteners/zero calorie alternatives, increasing total daily steps per day etc etc.