Thank you Budy,
Well this seemed a bit odd, but that helped. Since I'm still benchmarking, I don't have replication setup, nor mirroring, nor backup.
Actually deleting the volume is something I was able to do(after a reboot), but deleting the a volume group - that is something I cannot manage to.