Bury St Edmunds has a great market on Wednesdays and Saturdays. It is a fine East Anglian place. We enjoy going there. Often fruit and vegetables are as good in the market as in the supermarkets and far cheaper.
There is a small museum in the market square (at the back of the photo) called Moyses Hall in what is, I think, the oldest building there.