Process On Stage
Determines if the Delete Detection batch should be called after the source extract to staging process has been completed.
When enabled together with delete detection, the delete-detection processing runs as part of the object's staging load instead of as a separate stage: in Azure Data Factory the delete-detection pipeline is invoked from the extract-to-stage pipeline, and in Databricks the delete-detection notebook is appended to the object's notebook run list.
When to Change This Setting
Keep the default N to run delete detection as its own batch step. Enable it to have delete detection follow each object's staging load directly, so deletes are detected in the same run that stages the data.
Related Settings
| Setting | Interaction |
|---|---|
| Enable Delete Detection | Delete detection must be enabled for this setting to apply |
| Apply Delete Detection PSA | Whether detected deletes are applied to the PSA |
| Apply Delete Detection DV | Whether detected deletes are applied to the Data Vault |
Notes
- This setting is part of the Delete Detection settings category.
- The default value for this setting is
N.