Are you using a RAID controller, any errors on this that might be repairing or rebuilding.
Also try to go in to "Rescue mode". Restart system - after POST press the Escape key to enter a basic menu and select Rescue mode then try to remove the Logical Volume from Extended tools.