I believe the remains of Littlemill burned last fall, didn't it?
In the U.S., probably the most famed whiskey distilleries no longer in service are/were Michter's (PennCo) in Pennsylvania, the makers of what became A.H. Hirsch bourbons; and Stitzel-Weller in Louisville, KY, which made Old Fitzgerald, W.L. Weller, Cabin Still, Rebel Yell, et all (those labels survive under different ownership -- the distillery was mothballed in 1992).
I've been lucky enough to taste/select some barrels from the last distilling season of Stitzel-Weller (Spring 1992), so have a personal stock. Some of the more exotic, older labels bring uber-$500 prices at auction (mostly eBay).