Definately take the time to taxi or drive up to the castle - the sign posting is good and, although the route is a bit hairy (narrow road and lots of hairpin bends) it is only a few kilometres and it is soooo worth the trip. There are cafes at the top (very reasonable prices) and the view is wonderful.
More