Based on what you've said thus far, that you were in the US on a B1/B2 visa then came to Canada and claimed refugee 2 days before expiry of B1/B2 visa, I suspect your claim will be denied. If that happens you won't get the chance to decide where to go, Canada will send you back to the country of your passport. If you want to return to the US, then you and your spouse should check into having you immigrate to the US with him (via a US forum as scylla suggested earlier). You will need to file a withdrawal of your refugee claim and get your passport back prior to IRCC making a decision for you though.