Fisher County is a county located in the U.S. state of Texas. As of the 2010 census, its population was 3,974. The county seat is Roby. The county is named for Samuel Rhoads Fisher, a signer of the Texas Declaration of Independence and a Secretary of the Navy of the Republic of Texas.