Overall, the experience was unique and enjoyable.
Below are some key notes which are helpful to know ahead of time:
-There is no opening/closing time to the caves, but the visitor center closes at 1700.
-There is no lighting in the caves—after the first 50 meters, everything is pitch black. Flashlights are a must (we just used our iPhone flashlights.
-There are no restrooms inside the caves. We took the lower cave trail (just shy of 2 miles round trip) with our kids, the youngest of whom was 3. They all did fine throughout. If the trail had been longer, the lack of a restroom would have been a problem.