I'm personally an advocate of always having some element of sophistication or dressiness in an outfit. Dress shoes can make the most sporty or casual outfit more elevated and sharp.
Give the sneakers a rest for a day, eh?
But just don't end up like this guy