certbot

This removes the certificate and all relevant files from your letsencrypt config directory.
certbot delete --cert-name mywebsite.com