In winter-time

I'm Mr White
(with beard to match)
In Spring I'm Mr Green
In Summer I'm Sir A. Fairweather
In Autumn I'm Mr Goldman
And when I venture into town
in Winter I am Mr Brown.