You can't claim points for your brother. He needs to be actually living in Canada.
Yes - it will be a huge problem if you receive ITA and submit your application claiming these points. As said above, be prepared for a refusal at a minimum with the risk of being banned from Canada for 5 years.