You are not in compliance with the residency obligation. There is always some chance you could be questioned about this at the point of entry. Since you have time remaining on your PR card validity, the chances of being reported for failing to meet the residency requirements are likely quite...