You can change configurations of a drawing view at the very top of the drawing view's PropertyManager, or by right-clicking on the drawing view and choosing Properties.
I see that box now but it's grayed out. Does it have to do with having a BOM?
I realized my problem. I was trying to change the configuration of the section view. I didn't even process that there was a parent view since I had hidden it. You were correct.