It will help if you can clarify the following:
1. what was your relationship with him in 2004? Were you dating each other? People can rent seperate rooms in an apartment and keep separate bank accounts but still be in a relationship.
2. In Jan 2006, you both move to another city and rent a one bedroom apartment.
a) were you boyfriend and girlfriend then?
b) what are the odds of a male and female who had lived at the same address in 2004, to again move to another city in 2006 and live together but say they are just "sharing rent" as "roommates"?
3. When (month and year) did you guys become girlfriend and boyfriend?
You have reason to be worried. From your story, I'm left with the impression that you guys were in a relationship likely from 2004 onward and possibly lived together for at least 1 year which made you guys common-law partners.
If an officer comes to the same conclusion, you may have another problem:
- you landed as 'single' when in fact you were not. This would be misrepresentation and could put your PR at risk.
- CIC could say your husband is not a member of the Family Class, so you can never sponsor him.
Of note, you have withdrawn your application. Unfortunately, you won't know for sure whether or not CIC made a copy of the entire application before returning it to you.
If you can, try to get some legal help before submitting a second time. Good luck and I hope it works out well.