The beach is beautiful, among the best on the Keys, but very rocky. If you plan to go into the water, make sure you bring beach shoes. The beach is fairly long and there are nice pine trees you can sit under if you don't want to be out in the sun. I found the beach to be very relaxing. You can rent chairs for $10 or bring your own. Rest rooms are typical public beach restrooms. Wet floors, iffy on toilet paper. Food is available and there are nice picnic benches.
The fort is worth visiting for the entry fee. The view from the top is very nice, and there is a ranger who does a talk about the fort.
For the price, the beach and fort are a great deal.
If you own or manage Fort Zachary Taylor Historic State Park, register now for free tools to enhance your listing, attract new reviews, and respond to reviewers.