You can only delete a Test Cycle that is in "DRAFT" or 'ABORTED' status.
-
Launch a Test Plan issue
-
Click the "Gear" icon from a Test Cycle in "DRAFT" or 'ABORTED' status
-
Click "Delete"
[Screenshot - UG0052_Test_Plan_issue_Delete_Test_Cycle]