Should all pages be in the index?

No. Filters, sorting, pagination, the basket, search results and technical pages do not belong in the index. If you leave them there, the robot uses up its capacity on nonsense and never reaches the important pages. Part of the work is therefore deciding what to exclude from the index by changing the settings.