Trigger Airflow Pipeline
Run the DAG from the Airflow UI or CLI
DAG completes dbt run → triggers cost analysis agent
Agent Writes Cost Data
Each run inserts rows into analytics.pipeline_cost_history
analytics.pipeline_cost_history
Refresh / Create Redash Dashboard/Query
If dashboard exists: agent calls Redash API to refresh
If not: agent creates a new dashboard
Last updated 5 months ago