If I understand correctly, you need to right click one of the drawings, hover over "alignment", and click "Break Alignment". This will allow the dimensions associated with the specific drawing to track with the drawing and leave the others alone. Hope this helps.
Try Ctrl + Q
If you changed how the model was drawn up, it'll lose reference to the face ID...