Skip to main content

Data Governance

LakeInsight integrates OpenMetadata to provide LakeSoul data assets, data lineage, and data quality features, with native support for LakeSoul workspaces and Domains.

Open it from Data Services > Data Governance:

Data Assets​

Use Explore to browse ingested data sources, LakeSoul databases and tables, and Flink/Spark jobs that process ETL data.

Example: LakeSoul table details:

Data Lineage​

LakeInsight collects global LakeSoul and upstream/downstream job information. In the data lineage module, you can query upstream and downstream relationships for a specific table or job.

Data lineage supports cross-workspace and cross-Domain views:

Data Quality​

Configure data quality rules per table and schedule them to periodically sample LakeSoul table columns for quality issues.

Set quality rules for a LakeSoul table:

Configure a data quality rule:

After creation, rules appear under each table at Observability > Data Quality > Test Cases. You can add a workflow to run checks on a schedule: