Browsing Metadata

End-users can browse metadata to gain insights into the data assets in the Databricks workspace. The following tools and methods are available:

Metadata Dashboards

Access dashboards that display metadata, including tags and descriptions, for schemas, tables, and fields.

Documentation

Refer to the knowledge catalog for detailed information about supported datasets and their metadata.

Databricks SQL Editor

Some users will have permissions to query the information_schema. These users can use SQL queries to explore metadata:

SELECT * FROM information_schema.tables WHERE schema_name = '<schema_name>';
SELECT * FROM information_schema.columns WHERE table_name = '<table_name>';

Common Use Cases

• Identifying Sensitive Data:

  Query the DataSensitivity tag to determine which fields contain PHI or are part of a HIPAA limited data set.

• Understanding Data Sources:

  Use the DataSource tag to browse supported datasets and their descriptions.

• Exploring Schema Details:

  View schema and table descriptions to understand their purpose and contents.

• Retention Policy Compliance:

  Query the RetentionPolicy tag to ensure data assets comply with retention requirements.

• Project Tracking:

  Use the ProjectAssociation tag to identify data assets linked to specific projects.

Related Documents

• Data Asset Tagging Implementation Guide
• Data Asset Tagging Overview