This is a known bug. Breadcrumbs will show up when you click on a lightweight component in the FeatureManager Design Tree, but not when you click in the graphics area. But they should show up when you click in the graphics area, exactly for the reason you state -- to save the mouse trip to the tree.
Thanks for your reply. I'll look forward to a future bug fix!