Little Torch Key is an island in the lower Florida Keys. Little Torch Key was named after the torchwood tree and is just south of Big Pine Key. It is a small, quiet Key with easy access to Key West (approximately 29 miles). For divers, the incredible corals of Looe Key National Marine Sanctuary are only a few miles away. The exclusive resort, Little Palm Island, is located just offshore of Little Torch Key. U.S.