I can't tell you about your specific hotel but if its downtown or in the inner harbor its easy to get to. There is a bus on every ferry and the main bus station is behind the Empress Hotel. There are shuttles from the ferry into downtown and to Butchart Gardens. Don't worry its easy to get into town.
Just so you know, from the ferry terminal it is about 30-45 minutes drive to the Victoria Regent. The variation in time is based on how heavy traffic is and what time of day you might be travelling. If you do what the previous post suggests and get the bus from the ferry to the bus terminal in Victoria you will likely have to take a cab to your hotel. It is possible to walk in about 20 minutes, but with luggage that could be a hassle. There is a city transit bus that would take you into downtown Victoria from the ferry terminal, but I would go with the earlier post and get onto the Pacific Coach Line bus on the ferry. They have a desk where you go and get your ticket on the main floor of the ferry.
Thanks very much for your replies, they are a great help.
I just thought I should add a clarification here: the BC Ferry terminal at Swartz Bay is 17 miles from downtown Victoria. I've known many visitors who were under the spectacularly false impression that the ferry from Tsawwassen (Vancouver) drops you off in the heart of the city. It does not.
If you're coming from the USA on the Coho ferry or the Victoria Clipper, then yes, you'll be dropped off in Victoria's inner harbour (downtown).