The original owners of Oak House are not known, but the family most closely associated with it are the Turtons who were living there by 1634. The house remained in the Turton family until 1768 when it passed to William Whyley, the "natural son" of John Turton. John Wesley preached at the house on two occasions in the late 18th century when it was in the ownership of William Whyley. It remained in the Whyley family until 1837. Following a succession of owners, Reuben Farley (three times Mayor of West Bromwich) purchased the property.