You may want to consider the Hocking Hills State Park region (Old Man's Cave). It's 15 minutes away from Nelsonville. It has a lot of lodging options including cabins and such. I've stayed at Old Man's Cave Chalets and liked it a lot.
Sorry I don't have any info on B&B's.