Please create a workflow with action remove from Automation and add the contact to the workflow.
 
remove from automation