Your work permit is not a travel document. If you don't need a visa to travel to Canada, you can come and go as you like. If you normally need a visa, you need to have a valid visit visa to be able to come back if you leave. It would be best for you if that is the case to apply for a multiple entry visit visa so you can come and go as you like while it's valid.
