Setting up workflows

Setup workflow for full ETL

  • Config Table Settings (TBD)
    • config_main
    • delta_rules
    • stage_rules

Setup workflow for ingestion

  • Config Table Settings (TBD)
    • config_main
    • delta_rules
    • stage_rules

Setup workflow for transform only

  • Config Table Settings (TBD)
    • config_main
    • delta_rules
    • stage_rules

Setup workflow to reprocess a date range

  • Config Table Settings (TBD)
    • config_main
    • delta_rules
    • stage_rules

Updated on August 12, 2025