There is a difference between disabling and removing a mail contact. Disabling removes the Exchange attributes of the user but it still remains in the Active Directory while removing it, deletes it permanently from the Active Directory.

To disable a mail contact, click Disable under Actions column.

To delete a mail contact, click Delete under Actions column.