will they suspect? yes, they will. does it mean you'll be refused a visa? not necessarily.
if your children are minors, you have the right to bring them along to Canada.
http://www.cic.gc.ca/english/information/faq/work/work-faq06.asp
of course, you'll have to convince the IO that you intend to go back to your country after the visa expires. and that will be difficult to do, since in theory you have no "family ties" left in your country of origin.
good luck!