A lot...... It is annoying.
All the time. But sometimes I take the old phrase "If you can't beat them, join them!!"
So at times I found my self using the functionality of the pallette figuring it was up and I could make a quick update.
Since the introduction of the little "activator" box, not too often thankfully. However, it would make sense for the "entry point" to NOT be on top of an icon. I suggest the box should appear centred under the cursor.