Dataform

Masthead’s Dataform integration provides observability across your Dataform action tags. Monitor execution of workflows, track costs, and optimize performance across your Dataform projects.

Note

An account running an installation should have Owner role, or alternatively, the following roles are required in the Google Cloud project:

• Logging Admin
• Project IAM Admin
• Pub/Sub Admin

Connect via OAuth

Open Integrations page.

Click on Connect button in Dataform section.

Click on Add project, enter the project ID and choose Deploy with Oauth to configure connection.

Note

Masthead doesn’t store OAuth token.

Connect via Terraform

module "masthead-agent" {
  source  = "masthead-data/masthead-agent/google"

  project_id = "YOUR_PROJECT_ID"

  # Enable modules for the used services
  enable_modules = {
    bigquery      = true
    dataform      = true
    dataplex      = true
    analytics_hub = true
  }
}

More details about the module on Terraform Registry.

Cloud resources created:

• Dataform Viewer role for Masthead service account (read access to repositories and workflows)
• Cloud Logging sink for Dataform workflow execution logs
• Pub/Sub topic and subscription for real-time workflow monitoring

What’s Next

Visit your Pipeline Observability to monitor Dataform workflows.