Little Galloo Island is located in eastern Lake Ontario near the entrance to Sackets Harbor in Jefferson County, New York, within the jurisdiction of the Town of Hounsfield.