Maybe it´s sensitivity in the mouse (DPI). I tried to recreate your problem and I barely managed to to that.
You could make a drawing from the part in flattened state, scroll to the Flat pattern display and close it. Delete the part from your drawing and save it to template. Next time you make a drawing with flat pattern the default "Flat Pattern Display" will be default closed, then you will not get the problem when scrolling down.
Hope I´m clear.
Great idea. That was exactly what I wanted. Thanks