Dataplex

Masthead's Dataplex integration enables data quality monitoring across your data assets.

An account running an installation should have Owner role, or alternatively, the following roles are required in the Google Cloud project:

• Logging Admin

• Project IAM Admin

• Pub/Sub Admin

Connect via OAuth

1

Open Integrations page.

2

Click on Connect button in Dataplex section.

3

Click on Add project, enter the project ID and choose Deploy with Oauth to configure connection.

Masthead doesn't store OAuth token.

Connect via Terraform

module "masthead-agent" {
  source  = "masthead-data/masthead-agent/google"

  project_id = "YOUR_PROJECT_ID"

  # Enable modules for the used services
  enable_modules = {
    bigquery      = true
    dataform      = true
    dataplex      = true
    analytics_hub = true
  }
}

More details about the module on Terraform Registry.

Cloud resources created:

• Dataplex DataScan Administrator, Dataplex Storage Data Reader and BigQuery Job User roles for Masthead service account

• Cloud Logging sink for Dataplex task execution and data quality logs

• Pub/Sub topic and subscription for real-time data quality monitoring

What's Next

After successful integration, track data quality scans and rule compliance with Data quality monitoring.

Explore Data Quality Scans to set up quality monitoring.