My sympathies. I remember having a problem like this when trying to make an annotation block. I can give you some general advice, but I'm afraid the only sure-fire solution is to compensate for the text shift.
Be that as it may:
- when you create your block, make sure you do it on a sheet set to display at 1:1
- Create your block over the sheet itself, not on a view
- If you've ignored 2, make sure all of the annotations and geometry are either on the same view or on the same sheet (geometry on different view will not be selectable when creating a block, but annotations will be)
- make sure that your text isn't an attribute
If you want to try uploading a drawing with your annotations and geometry, I can try tweaking settings to get the block to come out the way you want it.