Not necessarily too late if you already have a confirmed place from the college already and all your documents ready .Worst case you go for September intake if you do not get a permit through for May, there is no way to predict processing time accurately.
All depends from where you are applying how long the quoted average processing time is whether that influences your decision