Found the answer!
For some reason, doing a pack and go from file explorer or solidworks explorer gives you different options when doing pack and go from inside solidworks.
Below image is pack and go from inside solidworks and automatically included the design binder and folders. Even allows renaming the spreadsheet!
I don't know why these are different, and frankly it's an extra step to open an assembly just to pack and go, but this does work.