The Spouter Inn is a favorite of ours and we always try to eat there once or twice during our visits.
They have some awesome chowder and beautiful views.
Wait staff is pleasant and knowledgeable.
Prices are reasonable.
Heads up- Beaufort now charges for parking, so if you haven't been there in a while, be advised.