Where to stay in the UK?

I am a CA college student planning a two week vacation for summer 2010. I want to go to the UK but can't decide where. I am a little old fashioned and don't much care for the fast-paced club scene. I am a fan of Georgian and Victorian architecture and I love 18th and 19th century literature. I suppose I'm looking for a scenic place much like the Lake District or Edinburgh, but am not quite sure. I have been to London and liked it very much but I want to see more historic sites. A place that is fun and has good shopping as well. Does anyone have any suggestions?