In the Project Inspector, the Remove button (with the minus icon) will remove any package not required by the project.
If the package is actually required, the Add button (with the plus icon) offers four choices of what you can add. The "New Requirement" option allows you to specify any known package as a new requirement for the project. Using this option allows you to add back a package that you had earlier removed by mistake.