To delete a contract, simply go to the contract overview and click on the corresponding contract. There you can delete single contracts by pressing the toggle switch "Remove contract".