So it turns out, if you've claimed assylum via Airport/Land border, CBSA has your passports and local CBSA office can be contacted to retrieve the passports. Any inland assylum claims, offices like Etobicoke will have the passports and need be contacted.