Yes, if you want to delete the subtitles you just need to go to the subtitle editor and roll out the menu above the subtitle sidebar.  Your subtitles will be deleted.