Probably not, because if you do make the points, it doesn't matter whether you have been to Canada or have not been to Canada, you'd probably get the points. On the other hand, if you had overstayed then it would be considered a bad thing.
While I am saying that you previous visit to Canada is not necessarily positive, I am also saying that if you made the minimum requirement points and fit the other criteria, you'd get PR.