If you create a new group it takes you to the details page of that group. Attempting to immediately delete the group from that page fails. Going back to the groups page and selecting that group again does allow you to successfully delete the group.
Note that attempting to delete a newly-created user in this way does succeed.
I was able to delete the group initially.
The issue is the Delete takes some time.
We need to loading dialog after you delete the group to tell the user its working