This is correct. You will need to insert a new part to achieve what you want. Just go to Insert > Component > New Part. You can then edit this new part to create the feature you want.
As Derek said, you can only remove material directly in an Assembly. You can add material only in a Part. However, this can be a virtual Part (contained completely within the Assembly, and not having a separate file).