There is a Money Exchange right in Gustavia when you first drive into town. You go upstairs and exchange your money for Euro's.  Don't expect to bring a check and open an account there. You have to be a resident there for that. If you have a debit card you can use the the cash machines in front of the bank for quick withdrawals.