BigQuery

Masthead's BigQuery integration provides comprehensive data observability, cost optimization, and governance for your core data warehouse. Monitor data pipelines, track costs, and ensure data quality across your BigQuery environment.

An account running an installation should have Owner role, or alternatively, the following roles are required in the Google Cloud project:

Connect via OAuth

1

Open Integrations page.

2

Click Connect in BigQuery section.

3

Click Add project, choose Deploy with OAuth and enter the project ID to configure connection.

Masthead doesn't store OAuth token.

Connect via Terraform

module "masthead-agent" {
  source  = "masthead-data/masthead-agent/google"

  project_id = "YOUR_PROJECT_ID"

  # Enable modules for the used services
  enable_modules = {
    bigquery      = true
    dataform      = true
    dataplex      = true
    analytics_hub = true
  }
}

More details about the module on Terraform Registry.

After applying the Terraform configuration, go to Deployment page, click Verify custom deployment and enter the project ID to complete the integration.

What's Next

After successful integration, Masthead provides comprehensive insights within approx. 20 minutes:

  • Data observability - Monitor table freshness, pipeline health, and data quality

  • Cost optimization - Analyze compute and storage costs with actionable recommendations

  • Column-level lineage - Visualize data flow and dependencies across your warehouse

  • Performance insights - Identify optimization opportunities for queries and resources

Explore your Observability Dashboard to get started.

Last updated