My wife and I just returned from a Cabo San Lucas vacation. We took one whole day to travel to Todos Los Santos because another guest at our hotel recommended it. Don't waste your time!
Todos Los Santos combines the shabbiness of Tijuana with the high prices of Aspen. Cafe Santa Fe - supposedly a 'great' Italian restaurant in the middle of a Mexican desert - had a spaghetti lunch for $28! My wife and I got up and walked out.
The town itself is nothing more than a bunch of overpriced 'art galleries' and restaurants. And it is 2 or 3 miles from the coast - so forget atmosphere.
Lastly, the road to Todos is very dangerous. It is a narrow two lane road with no shoulder and steep dropoffs on either side on which big rig trucks and buses customarily cruse at 110 kph (although the posted speed limit is 80 kph) and they expect you to do the same. If you don't then they pass you -- hills, curves and no passing zones be damned.
Spend your time in Cabo or go down to Buena Vista, but forget Todo Los Santos!