XN-Matt At the moment it's not possible to 'delete' a server group that isn't in use. For now you'll need to add a server to the group you would like to 'delete', then delete it by selecting the pencil next to the group name on the Servers overview page.
We have some improvements coming to 'server groups' that address this issue and offer additional functionality including the ability to reorder groups.
