Run

Deploy, upgrade, monitor, and administer the DataForge platform.

Deployment

• Cloud Quickstarts — fast Terraform-driven setup on AWS or Azure

• Private Deployment — AWS — full enterprise deployment on AWS
• Private Deployment — Azure — full enterprise deployment on Azure
• Restart procedures — restarting API, core, or Outcrop containers

• External API and other shared deployment tasks

Upgrades and maintenance

• Version upgrades — version-by-version upgrade guides
• Maintenance windows — scheduled platform maintenance
• Cleanup — clearing out unused metadata and storage

Monitoring and alerting

• Process alerts — SNS, SMTP, and email notifications
• Metadata monitoring dataset — query the metastore
• Spark and Databricks — Spark concepts and tuning

Cost management

• Cost Management — Databricks cost dashboards and production workload recommendations

Administration

• Data collection and privacy, Help Center terms of service, open-source software list

• Support access — granting DataForge access to your cloud infrastructure

• Private cloud management — managing private-cloud DataForge environments