Skip to content

Creating Data Warehouse and Loader Script

Steve Cook edited this page Feb 1, 2018 · 3 revisions

A dedicated Data Warehouse is recommended for use with Metabase, to provide some isolation from the live dataset in Fixometer. This allows a subset of data to be made available to Metabase, while the dataset remains stable and static during each day.

To setup the Data Warehouse for Metabase:

  • Create a MySQL database
  • On e.g. the server that hosts MySQL:
  1. Create a Linux user 'warehouse' and installation directory
sudo adduser warehouse
sudo mkdir /opt/warehouse
sudo chown warehouse /opt/warehouse
  • Then login as warehouse user:
mkdir /opt/warehouse/scripts /opt/warehouse/config
wget "https://github.com/TheRestartProject/DataAnalytics/raw/master/scripts/loadWarehouse" -P /opt/warehouse/scripts/
wget "https://github.com/TheRestartProject/DataAnalytics/raw/master/config/fixometer.db.config.example" -P /opt/warehouse/config/
wget "https://github.com/TheRestartProject/DataAnalytics/raw/master/config/warehouse.db.config.example" -P /opt/warehouse/config/
  • Edit the config scripts to set the correct parameters for the Fixometer and the Warehouse database servers

  • Setup a cron job to run the loader script

Clone this wiki locally