The museum was closed for renovations but I could see they just had a few barges to see. The river was high. The barges were surrounded by 6-8 inches of water so going in was not a good idea any way. The place is very small. To get there you have to follow a winding path through what I would politely call a "blighted area". It was not worth the time and effort to go there.
If you own or manage Royal Barges National Museum, register now for free tools to enhance your listing, attract new reviews, and respond to reviewers.