Scaborough is not a nice area of the City
Not too many things to do, not as safe as you could expect, they have gangs, there are some news about racial crimes, and some psychos that came up from this area (the last one a supremacist who kill a young Asian student in Montreal and sent parts of his body by courier) of Toronto gave Scarborough a bad reputation.
But is not a hell hole after all, there are a lot of students in the area, and think about it as a temporary stage only, once that you finish your studies you can move.
And you can always go to Downtown Toronto to spend the weekends lol