Not necessarily, let say you never left Canada since you moved here and you never worked during your eligibility period in this case employment is not the strongest physical presence ties. Your last entry into Canada can be found easily by CBSA.If you traveled a lot during your eligibility period and you recorded your absences exactly without missing any date, I do not think unemployment will be a problem here.Also keep in mind that there are a lot of other way to proof your residency if you were asked to.