Automated Data Catalog Curation

This cookbook demonstrates how to integrate Chicory AI with your data stack to extract the column level metadata based on the schema requested. The agent is triggered on new data asset creation via the cloud run function in Bigquery, this could be integrated with any data warehouse scheduled job runs.

---

Quick Start

1. Build the monitoring table and policies for your sample data

2. Build the agent and deploy it

3. Build the cloud run function

4. Create a new data asset

5. Trigger the cloud run - This triggers the agent with the new table schema info and gets back the column level desciptions back to the BigQuery table

---

Contents

• Introduction – Introduction to setup and tools

• Agent Monitoring Table - Create new data asset monitoring table

• Build Taxonomy Policies - Build/retrieve the data governance rules

• Agent Creation – Creating a Chicory Agent

• Trigger Agent - Trigger the agent via cloud run

• Sample Catalog – Example catalog output from the agent

• Troubleshooting – Common issues & fixes

---