I totally agree that the water fountains in front were the main highlight of this Plaza in front of the Federal Building. Another T.A. poster commented they couldn't see any fountains. It might be because they had a market fair or event in the square. The fountains don't work when they have events. (See my photos as earlier in the day there were trucks on top and there weren't any fountains but later in the afternoon when we passed by we got to experience them...so try going later in the afternoon).
The building was closed for tours. We were there on a Saturday but the fountains in front were the highlight for our young kids. They absolutely loved them and ran around with other kids trying to avoid from being splashed. Other parents, just let their kids take off their street clothes and run around in the water.
A beautiful square in front of the building and there is a water fountain off to the side that is also nice. And don't forget to walk in back of the building where you can see a nice view.