Skip to content

Latest commit

 

History

History
36 lines (21 loc) · 1.09 KB

README.md

File metadata and controls

36 lines (21 loc) · 1.09 KB

PostgreSQL Data Profiling Connector

This connector extracts column-level data profiles from a PostgreSQL database using asyncpg library.

Setup

You must run the connector using a user with SELECT privilege to all tables.

You can use the following command against all schemas:

GRANT USAGE ON SCHEMA [Schema];
GRANT SELECT ON ALL TABLES IN SCHEMA [Schema] TO [User];

Config File

The config file inherits all the required and optional fields from the general PostgreSQL connector Config File.

Optional Configurations

Sampling

See Sampling Config for details.

Testing

Follow the Installation instructions to install metaphor-connectors in your environment (or virtualenv). Make sure to include either all or postgresql extra.

Run the following command to test the connector locally:

metaphor postgresql.profile <config_file>

Manually verify the output after the run finishes.