OK, so Lake Louise is a must for you. Here's what I'd suggest:
You are correct in flying between Vancouver and Calgary is your best option. Its a long way, with several mountain passes between here and there. Its an easy run from Calgary up to Banff. Plan on a few days in Banff, and do Lake Louise as a day trip. There's not much in the village at LL, and you will have more options around the town of Banff. Get your advice for this part of your trip from the good folks on the Canadian Rockies forum who are much more familiar with it all than me.
While it can be a bit of a dreary place that time of year, I think you can have a good time here on the coast if you are prepared for the conditions. Definitely plan a storm watching visit to Tofino on Vancouver Island:
Whistler usually opens for skiing in late November, but as you are already going to Banff, you may not want another ski resort. However, they do have their Cornucopia festival in November I believe (however, you would probably need to find a babysitter to enjoy most of that I think. Check with Tourism Whistler for your options there). And overall, Whistler is a fun place with lots going on.
The other place to look at going is the "rain shadow micro climate" region on the eastern side of Vancouver Island. This area tends to be warmer and drier than every where else and is a good choice in the shoulder season. Look at the southern Gulf Islands (such as Saltspring and Galiano) and the resort town of Parksville.
I hope you don't feel this is a complete disaster. Its not the best, but given your parameters, if you plan this carefully, I think you can have a really good time. Travelling with a young child is very restricting anyway, so you wouldn't be able to dash about doing everything. What is good about November:
** low season rates in some very expensive places
** you will not have to prebook anything - there will be vacancies anywhere you want to go and you will have the place more or less to yourselves when you get there.
Get a plan together, but maybe leave off the actual bookings, then you can flex with the weather conditions once you arrive and see how you feel in different places.