You should save the font settings in the drawing template.
So first you open a new blank drawing document. Go to tools->options->document properties and set the font you want to have for annotations, dimensions, notes etc. I think there is about 4-5 places to define font for various items. After this is set, click ok to close window. Then you go to File-> Save As, and select drawing template drwdot. Next time you make a drawing, use this tempalte instead and all fonts are good.
Thank you very much for the reply.
I managed to open and save a blank template as a .SLDPRT with the text font and size.