Last year we spent the holidays in VT and I made a trip to Scrapbook Nook in Bellows Falls, VT --
http://www.scrapbn.com/index.html. They have tons of papers. I don't remember what their stamp selection was like. It was the first non-chain store I had been to so I was very very impressed at the time!!
I mapped it from Saint Johnsburg. Bellows Falls is about 100 miles south, off Rte 91. I don't know what you mean by start of VT (bottom of VT?), but if you are driving up 91 and if you have the time, it's worth a stop! Have fun in VT -- what a gorgeous state!!