My husband and I kicked off our holiday in Morocco with 3 nights at the Kasbah Angour and I could ideally have done with an extra day there. The grounds are stunning and the view towards the mountains perfect. The hotel itself is well laid out - it felt more like staying at a friend's villa than like a hotel. The staff are all friendly and attentive without being in your face. Other reviews comment on the food on offer and other little things like the absence of fancy little toiletries. In my view, fancy food and toiletries would have spoiled the feel of the place which to me is luxurious but honest.
In our 2 full days there we did a 6 hour energetic walk in the mountains and a half day mountain biking. Both trips would probably suit someone fairly fit but you don't need to be Paula Radcliffe or Bradley Wiggins.
You can also go on day trips to Marrakech which is only about 30 minutes away by car. However, this wouldn't have worked for me because I felt that Marrakech took at least a day to get used to and start to feel at home - after that I really enjoyed it.