There is a museum of local artifacts and historical items on main street just prior to Rt 194 (as you come from Westminster).
For more info see:
http://www.taneytownmuseum.org/ - 410-756-4234
Hours are :
Friday 10 AM - 1 PM
Saturday 1 PM to 4 PM
Sunday 1 PM to 4 PM