Skip to content

code for ETL job which leverages Looker SDK to grab and format data which ETL's directly to Big Query

Notifications You must be signed in to change notification settings

alick-at-google/content_access_etl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Content Access

The content access repo is used to grab data necessary to help answer questions regarding content access for users on an instance

code for ETL job which leverages Looker Python SDK, Pandas to grab and format data which ETL's directly to Big Query by leveraging BigQuery API

The 2 code files are used to Leverage Looker's Python SDK and enable users to find and manage content access at both a group/user level

content_access.py is Looker Python SDK-specific code used to generate tables necessary to obtain data. Tables are broken into:

  • folder
  • folder_access
  • content
  • user
  • group

alt text

etl_to_bq.py leverages the BigQuery API and automates ETL process by directly uploading/updating tables based off ETL job. This file can be hosted on a server to automate and run based off cron. Be se sure to run this code in a secure network/platform like Cloudtop since there are json/p12 keys involved

ETL job should be done into BigQuery database and we should be able to use the predefined block listed here to generate prebuilt dashboards/content

About

code for ETL job which leverages Looker SDK to grab and format data which ETL's directly to Big Query

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages