I usually exercise in the early evening, immediately after work. My stomach is not empty but I am usually getting hungry as I haven't eaten since lunch, does that count?!!
I have to say, I do find it really helps to suppress my hunger and appetite until dinner better than if I don't exercise.