Agent Monitoring Table

Steps:

1

Create a new table to detect new data asset creation

368B

create-monitoring-table.sql

2

Execute a new table detection scheduler for every 5 min under the scheduled queries tab. Here the "reference_dataset_id" is the "dataset_id" under which a new data asset/file

is created. Refer to the BigQuery job scheduler details for more info: https://cloud.google.com/bigquery/docs/scheduling-queries

664B

new-table-detection.sql

3

Add a new data asset

---