Given the Link to Property options you have for Notes in drawings...
The only way that it might be possible to do this is to use both "Model in view to which the annotation is attached" and "Model in view specified in sheet properties". You would define each of these to be a different configuration of the model then, in the note, make two separate Links to Properties pointing to each option. In theory, since each option points the property link to a different configuration it should be able to pick up different property values. I worked up a quick experiment and it seems to work:
Attached are the test files as well
This is the exact option I would have used to solve this problem.