The only way to remove the Volume Group is from the Extended tools from Console. From the console enter CTRL + ALT + X then select "Delete content of units" select the proper Volume Group to delete it then the system will reboot.
This is in the Manual as well on page 39.