You can lose your permanent residency if you don't live in Canada for the amount of time required, it's not only the Citizenship what counts in this case.
From: http://www.cic.gc.ca/english/newcomers/about-pr.asp
Time spent living in Canada
When you are a permanent resident, you can live...