We hope you enjoy your visit to Columbus.
First things: Columbus was hit by a powerful windstorm last Fri 30 Jun. Quite a few places are without electricity & it may not be fully restored until this weekend (07 Jul). So my first recommendation is to call any place you might be visiting to make sure they are open. But the city is not destroyed :) just rather intermittent electricity.
Centrally located with local atmosphere would be in the Short North / Victorian Village area of Columbus. It is along N. High St, just north of the downtown area. Also the German Village area just south of downtown. There is a Hampton Inn on High St with the North Market Farmer's Market nearby. Other larger hotels on Nationwide Blvd, the north edge of downtown.
There are a few of B&Bs around - Harrison House on W 5th (Victorian Village), 50 Lincoln St on E. Lincoln (Short North), Neil Ave B&B (Victorian Village), Victorian Village guest house on Neil Ave, German Village guest house on Jaeger St.
Unfortunately, both the Short North & German Village are mostly walking.
Try an internet search for more B&Bs; they may not all be listed on TripAdvisor.
Farther north in Worthington, a suburb, is the Worthington Inn, a historic hotel. There will be a farmer's market along their village square on Saturday. That farmer's market is very busy & fun. Their restaurant has brunch also.
Brunch: Explorer's Club on S. High St; Till Restaurant at 247 King; Lindey's in German Village. Lindey's & Till are high-end restaurants.
Hopefully the other Columbusites will be able to check in with recommendations too!