Simply, no, but kinda yes.
I normally hold shift, as you describe.
You can also use the separate command, SELECT, which allows you to select as many things as you like without holding a key. Then, begin new command with items selected, which means don't deselect before doing something useful with them.
Do know about window selecting items?