Steaky, you'd want low interest rate so that your payments are smaller. You can only deduct the interest portion of the mortgage payment not the part the goes towards the principal. And you're right, technically it's a bad idea to pay it off sooner, unless you need cash.
Blueshirt, mortgage can be transferable to a different property if you sell, but read the rules closely.