The entire entry has to be deleted. Once you click the delete field, you will get the following confirmation question.