If you have the time and can find a parking spot you should make it a point to see the VT State House. It has a number of interesting stair cases and portraits throughout.
Check the website for tour times or go on your own. Still one of the few State House's that you can just walk in. You might even get to see the Governor.