In the Configuration Manager, select “Edit…” in the “Configuration” column for each project (not via the dropdown named Active solution configuration) that has configurations you want to remove.
In the dialog that pops up, mark each unwanted configuration and select “Remove”.