I agree with staying in Fishkill over Middletown, especially if you are going to Hyde Park. Kingston is also very accessible and I would also consider staying there (and the bonus is you avoid all the stop lights on Route 9). I'm speaking strictly on Kingston location in general - not sure where the Courtyard is there.
Places you might like near Fishkill Marriott:
Il Barilotto (upscale Italian)
We also like (but not upscale):
Tanjore (excellent Indian food)
Cafe Maya (Mexican food)
Tomato Cafe (tasty salads, pastas, pizzas, and yummy desserts)
Breakfast spot to grab a bagel/sandwich:
The Bagel Shoppe
If you are in the Hyde Park area on a weekday, check out the Apple Pie Bakery at the CIA. Also north of Fishkill I like Crave (Poughkeepsie), Terrapin (Rhinebeck), and Mercato (Red Hook - probably too far for you - but still great). I haven't eaten yet at Gigis in Rhinebeck, but it's supposed to be good too. Also, Artist's Palette in Poughkeepsie is good.