Is there a way to turn off the requirement of a delivery contact on the sales order?

We are running into an issue where the contact for the sales order gets removed from our system which leads to an error message that the delivery contact doesn't exist. 

We would like to just not have this field as a requirement as we don't use this information. 

We are currently on V11, patch 14. 

Thanks,
Chris