It is highly depending on CRA. It won't be easy if it is favour for CRA. Try to apply first, if the result is no then I think the more conservative way is to spend more time in U.S. Canadian tax rate is high.
I think if you and your wife live in US, you can try to apply for non-resident of Canada tax purpose. Usually CRA won't approve non-resident if spouse is living in Canada.