Growing up I hated the color green, but like you I eventually figured out that it wasn't the color per se but the association with artificial lime flavor which I loathed. It was a useful revelation because it turns out I really like wearing clothes in many shades of green.

I'm not fond of fruit flavors in general either. Gum drops are particularly tricksy because they can be delicious spice flavors -- cinnamon, mint, clove -- or nasty fruit flavors.