You most likely have some sort of internal boot media(which is now bad). Replace it, and go through the install process again, and you can ditch the USB key.
Best option would be to boot from SSD if you have the spare bay.