Monitoring and Alerting¶
Watch what DataForge is doing and get notified when something goes wrong.
- Process Alerts — SNS, SMTP, and email notifications for failed processes
- Metadata Monitoring Dataset — query the DataForge metastore from Databricks
- Spark and Databricks — concepts for tuning Spark performance and cost