Stop obsessing over calories
Being too obsessed with calories might force you to severely restrict your overall energy intake and avoid foods that you enjoy, in addition to taking up time, effort, and mental energy. While measuring food intake might be beneficial in the short term for some people, obsessing about how many calories you consume on a regular basis can harm your relationship with food and cause unneeded stress.
Rather than completely avoiding sugar, reducing total sugar consumption is beneficial. It's much easier to restrict sweets if you can have them whenever you want (even every day!). No food is considered "forbidden". A diet consisting primarily of high-quality carbs, proteins, and fats, with some sweets and desserts, will be far more achievable and realistic for long-term success than completely eliminating a specific food group.