I haven't been to Ontario at all, but I don't think there is a real answer to that question.
It all depends on personal views. I have friends who do not like the area I live in at all and some think it's okay. I think you'll have to figure it out by yourself.
I'm pretty sure that both Milton and Waterloo have good Schools and Parks and nice places for families.
Good luck!