The visa officer will note the TRV refusal. In the forms you have to say that you have been refused a visa; there is space to explain. If the applicant applied for the TRV in order to see his or her sponsor, then say so there.
One refusal should not make a difference. But the more refusals you have, the more suspicious they will be, in particular if the applicant comes from a country where CIC believes marriage fraud is common.