Edit the calloutformat.txt file to eliminate the tap drill size call out. That is what was done where I work and we have not had any problems in 8 releases (over 18 years).
This reminds me of what one of my drafting instructors told us once.
"Don't tell them how to make the hole (like drill and ream). Give them the diameter and required finish. You don't care if they chew it out with their teeth."
The image that comes to mind when I remember that always makes me laugh.
The best I can suggest is to make up a hole favorite (I think that's what they call them, not on SW right now) for holes you use often. I'm pretty sure you can have custom callouts for them.