The only reason why a delete button doesn't exist is because no-one has implemented it yet.
I created a feature request for that in the
old bug tracker in 2009. ;-) (It is not in our current bug tracker yet.) Pull Request welcome. If you're not a developer, you could pay someone to do it.