A chapel in the town's St Mary's church was restored in his memory in 1862, and a local community college also bears his name: Sir Harry Smith Community College.
Ett kapell i Whittleseys kyrka restaurerades till hans minne 1862 och en skola i staden bär hans namn; Sir Harry Smith Community College.