Dataform

Masthead’s Dataform integration provides observability across your Dataform action tags. Monitor execution of workflows, track costs, and optimize performance across your Dataform projects.

Connect via OAuth

Open Integrations page.

Click Connect in Dataform section.

Click Add project, enter the project ID and choose Deploy with OAuth to configure connection.

Connect via Terraform

module "masthead-agent" {
  source  = "masthead-data/masthead-agent/google"

  project_id = "YOUR_PROJECT_ID"

  # Enable modules for the used services
  enable_modules = {
    bigquery      = true
    dataform      = true
    dataplex      = true
    analytics_hub = true
  }
}

More details about the module on Terraform Registry.

Google Cloud resources created:

Dataform Viewer role for the Masthead service account to provide read access to repositories and workflows
Google Cloud Logging sink for Dataform workflow execution logs
Pub/Sub topic and subscription for real-time workflow monitoring

What’s next

Visit your Pipeline Observability to monitor Dataform workflows.