Embassies are sovereign territory of the representative country. IE: the US embassy in Canada is US territory & vice-versa. You go into a country's embassy, you are *IN* that country.
As for PEI, they fly the Canadian flag as you would expect them to.
As for Quebec, they consider Quebec...