@adamwathan generally, you're supposed to collect / remit taxes for all provinces.

http://www.canadabusiness.ca/eng/page/2651/