You, as a spouse of inadmissible primary/secondary applicant can visit Canada. However, when you apply for PR, you will also be deemed inadmissible because of your spouse's inadmissibility.
In first scenario, you will be then good to go. In the latter case of him getting over his inadmissibility, you will both be able to apply as a couple for the PR.
Of course you can re-marry your husband, no one's going to stop you. However, whether you'll be able to sponsor him for Canadian PR or not, or whether your sponsorship will be accepted by IRCC is a different question.
Considering the complexity of your circumstances you wish to go through, you should consider hiring an immigration attorney.