Introduction

This cookbook shows how to use Chicory AI agents can be used to generate data catalog for a new onboarding data asset.

Tools & Integrations

  • BigQuery – SQL execution and runtime insights

  • REST API – Deployment mechanism for Chicory agents

What You’ll Build

A Cloud Run function that:

  • Gets triggered when a new table is detected

  • Pushes the new table schema to the agent

  • Polls for the response from the agent

  • Extracts the column description and policy_tags from the agent output

  • Pushes the metadata catalog back to Bigquery

A Scheduler job that:

  • Can be triggered on a schedule when a new table is onboarded

An agent that:

  • Scans the schema and analyzes patterns by referring to the sample data

  • Refers to supporting documentation/code

  • Suggests rich columns descriptions

  • Gives the output in a json format

PreviousAutomated Data Catalog CurationNextAgent Monitoring Table

Last updated