If they leave Canada without their parents yes. If the whole family leaves Canada you should call CRA and they will decide whether you get paid the CCB based on your specific circumstances. It is certainly easier to contact CRA before than to be asked to pay back the funds.