Logical Architecture

DataForge operates differently from traditional ETL tools. It helps to think of DataForge as a front-end wrapper for SQL — each change in the interface modifies the ultimate SQL that is executed. Each step in the architecture modifies a different portion of the overall SQL from ingest through output.

• Data Processing Engine and Steps — what runs when a process executes
• Data Storage — where data lives at each stage of the pipeline
• User Interface — what the UI exposes