You need to stop working as soon as you find out the visa was refused. You would not likely be in serious trouble for working between the time your visa was refused and when you received notice.
Assuming, of course, that you have no electronic access to the file (hence the mail)