We're a self-centered bunch today. We dress for ourselves rather for others, which is why I hear over and over that clothes must be comfortable and easy to wear.
Many of the details of dress that were a mark of elegance are condemned today as uncomfortable or too time-consuming. Loafers replace oxfords, and sneakers replace loafers. Returning home from work, men in what were once considered white collar pursuits change from their jeans into their more comfortable sweats. On vacation they transform themselves into backwoodsmen or tropical islanders.
Now some of this is because many men have never had the opportunity to wear good quality clothes that fit. I had a colleague once that refused to wear wool because the little of it he'd worn was scratchy. He apparently had an intimate experience with unlined tweed trousers.
Men who seek comfort above all will eventually find they have become slaves to trainers and sweat suits. Pursued as a goal, comfort is the enemy of elegance. And the rest of us are the poorer for it.