I will offer you my experience, and feel free to do with it whatever you wish:
I have binge eating in my genes, and know that many people consider sugars and flours some of the most dangerous food triggers for binge eaters. As such, I have seen these food with great caution and have chosen to abstain from these foods for most of my plant-based time.
As a result of this decision, my weight has been where I like it to be, for the last year and a half of my plant-based journey. I've had minor forays back into sugars and flours over the last year and a half, which I've regretted and had to do the painful work of digging out of. It is easier to remember and respect the addictive powers of sugars and flours, than to let them have their way with you, and then have to fight your way back out of their control!
My sense of food addictions, is that cutting out the worst binge triggers and binge behaviors, has not "cured" me, but it HAS been an extremely important step along the way. Someone who once binged on sugary foods, can easily transfer their behaviors to mangos, bananas, pears and dates.
As people tend to say, we indulge in our addictions because on some level, we like the way those make us feel. A pot smoker, smokes pot, because they like the way it makes them feel on some immediate level. An alcoholic takes a drink because that first drink feels good on some level. A compulsive spender whips out their credit card because in the moment, buying something gives them a high.
A food addict is no different! I understand that for me anyways, deciding to overeat (even if this means having a third bowl of broccoli) is something that I have done, because on some level I've enjoyed the way overeating makes me feel. At some point, I've had a dawning awareness, that I no longer wish to feel this way (bloated, overstuffed, off my path, etc), but it takes a bit of time to get to that place.
It also takes a persistence and a dedication, for me to undo the behavior patterns, even though I am pretty clear on not wanting the long-term patterns of overeating anymore. The grooves of hiding in the food are there, and it is a powerful temptation, to hide in the food once again.
Not sure if that will help you at all! Just my perspective, and see what feels right to you, on your path.