How is your sleep?
I also found that starch has bad effect for me. Grains are the worst, rice in the middle, tubers are the best but still not perfect.
Problem is that if i eat only fruits as carbs i can't sleep. That's why i am forced to include potatoes/sweet potatoes before bed.
What do you eat for dinner?
Incidentally my sleep is best with lots of complex carbs; grains like oats and brown rice/wheat really allow me to fall asleep easily; they also produce a very calm mental state. The problem is, as I mentioned, I physically deteriorate from them and my libido tanks, I have little idea behind the mechanism. The first symptoms are arthritic - type stiffness and pain in my fingers.
For me the order goes from worst to neutral - Grains, tubers and rice.
Dinner is usually just meat and rice with oj. I quite like white Italian pasta but I'm not sure if this also causes deleterious effects for me. Unfortunately I can only go completely go starch free when I do very little all day, if I'm active (most of the time) I need the calories.