The park takes its name from the tale of a great exodus of mice fleeing from a burning tannery in the Civil War period. Situated on the Tennessee River, the park offers beautiful moss-covered trails in the hollows and ridges of the Western Highland Rim.