The American saying that a man should wear no white after Labor Day has somehow come to be applied to all clothing, which makes no sense, instead of shoes (the original target), where it does. For one thing, it contradicts the more basic rule that one's clothing should reflect one's surroundings, which is how we came to wear grays in the city and brown or green in the country in the first place.
The white to which I am referring of course is cream, that classic yellowed white that looks nothing like snow. Cream trousers have been worn by well dressed men for at least 80 years (they are shown with some frequency in Apparel Arts and Esquire illustrations from the 1930s). Patterned wool jackets make the best pairings, since cream trousers and a navy blue blazer are just a tad too nautical unless one is watching the America's Cup. Try mid-weight wool jackets with gabardine trousers and tweed jackets with flannel so the finish of the trousers relates to the coat. But wear cream year-round.
In the photo, cream flannel trousers with a gray glen check jacket, gray cashmere necktie, paisley silk pocket square and Russian calf cap toes.