My favorite activities have involved kayaking. Sea caves are spectacular and paddling through them is fun. Fairly easy paddling can be had - but go with a recommended guide if you cannot get back into an upset kayak easily and be sure to wear a wetsuit. Winds can come up unexpectedly but distance to mainland caves is short from Cornucopia. For the more adventuresome, there is kayaking to the islands and overnight camping. Sometimes in Feb ice is safe enough to hike into the frozen caves - absolutely fascinating! Check with park service first for safety. Don't like kayaking - lots of opportunities for relaxing and scenic boat tours. Nearby Bayfield has lots of attractions, good places to eat and interesting art shops.
If you own or manage Apostle Islands, register now for free tools to enhance your listing, attract new reviews, and respond to reviewers.