Whilst on Loblolly beach, we went for lunch at the Big Bamboo. The service was okay, but the food was excellent. I didn't try the 'famous' lobster, but my snapper was amazing, as was the mahi mahi.
The highlight of the day was the crazy old man, who randomly started performing for us whilst we were eating...weird, but fun...:D
There's also a little bar, where you can grab a cocktail before heading to the beach. The locals were very friendly (as I have found in most of the BVI's) and the background music really added to the nice, chilled-out vibe.
Highly recommended, especially when there aren't any annoyingly loud children about (speaking from personal experience, at least...)