For me the reality is that the later in the day it gets the less chance I will complete my walk. Not only is it hotter and more humid, there are more people out, especially little old ladies with yap yap dogs on those terribly long retractable leashes.
I really try to get out just before or after sunrise. Less people out and if I walk down my neighborhood streets I see people getting their day started. I'm not a peeping Tom but many of the home in our neighborhood have similar floor plans to ours and the kitchens are often up front so I get a feel for who has redone there kitchen and how it looks if the lights are on and the curtains open.