Code

Danibishop/longitude rework#32

Code

Merged

josemazo merged 52 commits intodevGeographicaGS/Longitude:devfrom danibishop/longitude-reworkGeographicaGS/Longitude:danibishop/longitude-reworkCopy head branch name to clipboardFeb 6, 2019

+2,648

Commits

Commits on Jan 23, 2019

• Scaffold as packagestarting in version 0.3.0

  

  Dani Ramirez

  committed
  738b144

• Scaffold structure including initial unit test structure + coverage configuration.

  

  Dani Ramirez

  committed
  8845ea5

• Scaffold for carto data source including tests.

  

  Dani Ramirez

  committed
  64073a7

Commits on Jan 24, 2019

• Added per-query configuration (+ default). Exception wrapping to hide the CARTO layer.

  

  Dani Ramirez

  committed
  37f443a

• Basic example added to query Carto

  

  Dani Ramirez

  committed
  44bf413

• 100% coverage for Carto data source. Common configuration for on premise and regular instances.

  

  Dani Ramirez

  committed
  fb53a06

• Added class to wrap query responses, regardless of the database specific response. Basic preview of returned values as table.

  

  Dani Ramirez

  committed
  7be594a

• Updated doc

  

  Dani Ramirez

  committed
  2c74c55

Commits on Jan 25, 2019

• Transparent cache logic inserted in base data source logic. README now has the roadmap checklist.

  

  Dani Ramirez

  committed
  8fb5849

Commits on Jan 28, 2019

• Basic RAM cache implementation. Source code folder structure rework to separate samples.

  

  Dani Ramirez

  committed
  ed0023b

• Basic Redis put/get feature. Cache config added. Updated README.

  

  Dani Ramirez

  committed
  63ba516

• Added flush to caches

  

  Dani Ramirez

  committed
  2458d02

• Picke as default cache serializer.

  

  Dani Ramirez

  committed
  000e826

• Cache now stores normalized payloads only

  

  Dani Ramirez

  committed
  3fff406

• Updated tests

  

  Dani Ramirez

  committed
  dcd2f10

• Added tests for Redis cache and RAM cache. Improved total coverage up to 95%.

  

  Dani Ramirez

  committed
  08aa397

• Cache configuration wrapped in class instead of dictionary (only for Redis for now). Password field added to Redis configuration, including associated error messages.

  

  Dani Ramirez

  committed
  fec1359

Commits on Jan 29, 2019

• Initial scaffold for postgres data source

  

  Dani Ramirez

  committed
  1d9c0fe

• Requied Python version updated to 3.7. Reference to shared google doc with roadmap removed.

  

  Dani Ramirez

  committed
  20ece33

• Merge branch 'danibishop/longitude-rework' into danibishop/postgres-interface

  

  Dani Ramirez

  committed
  f3a7005

• Basic Postgres sample running

  

  Dani Ramirez

  committed
  2ecf601

• psycopg2 package removed in favour of psycopg2-binary distribution. Fixed tests.

  

  Dani Ramirez

  committed
  fe2078c

Commits on Jan 30, 2019

• Write query comprobation removed. Closes #33. Use of cache is now configurable in a per-query basis using a bool parameter in the query() method.

  

  Dani Ramirez

  committed
  a50754f

• Previews for query response removed.

  

  Dani Ramirez

  committed
  edff45b

• Configuration logic extracted to simple class. Now it is common for data sources and cache classes.

  

  Dani Ramirez

  committed
  07054fc

• Cache can be safely disabled temporarily using the DisableCache context manager. Basic profiling times in the postgres data source. Added 'needs_commit' parameter to query method to avoid default c…

  Show description for 2dd8546
  

  Dani Ramirez

  committed
  2dd8546

• Common response class extracted to its own module. Rows data is now stored including field name, following the CARTO style. Closes #35

  

  Dani Ramirez

  committed
  60d4680

Commits on Jan 31, 2019

• Imports reordered (isort) and setup.py updated with current structure.

  

  Dani Ramirez

  committed
  4211956

• Updated pytest dependency. Added some pytest plugins.

  

  Dani Ramirez

  committed
  e449a3c

• Fix. Queries were being passed already formatted to the specific sub-classes. This avoided each database connector to deal with parametrized queries. This had implications on how the cache keys wer…

  Show description for 26e214f
  

  Dani Ramirez

  committed
  26e214f

• Fix. Queries were being passed already formatted to the specific sub-classes. This avoided each database connector to deal with parametrized queries. This had implications on how the cache keys wer…

  Show description for 5a2b610
  

  Dani Ramirez

  committed
  5a2b610

• Merge branch 'danibishop/longitude-rework' into danibishop/sqlalchemy-data-source

  

  Dani Ramirez

  committed
  e1d7773

• Added SQLAlchemy and dependencies updated.

  

  Dani Ramirez

  committed
  86a159b

• get_config() now returns default and custom configurations merged if no key is provided. Create table from model in SQLAlchemy seems to work (wrapped in data source object)

  

  Dani Ramirez

  committed
  d295ad1

Commits on Feb 1, 2019

• Merge branch 'danibishop/longitude-rework' of github.com:GeographicaGS/Longitude into danibishop/longitude-rework

  

  Dani Ramirez

  committed
  8aa0034

• Merge branch 'danibishop/distribution-rework' into danibishop/sqlalchemy-data-source

  

  Dani Ramirez

  committed
  415772f

• 100% coverage for config and helpers. 86% total coverage.

  

  Dani Ramirez

  committed
  120336e

• Sample use of SQL Alchemy using Expression Language

  

  Dani Ramirez

  committed
  6feda08

• Bugfix. Cache object was putting parameters instead of payloads.

  

  Dani Ramirez

  committed
  333e275

• SQLAlchemy data source full sample.

  

  Dani Ramirez

  committed
  10039b0

• Configuration object class created.

  

  Dani Ramirez

  committed
  a17482e

Commits on Feb 2, 2019

• Example for configuration file using a Carto and Postgres data sources combined

  

  Dani Ramirez

  committed
  7af7f58

• Merge branch 'danibishop/longitude-rework' of github.com:GeographicaGS/Longitude into danibishop/longitude-rework

  

  Dani Ramirez

  committed
  4a36a9a

• Expiration time added to cache interface

  

  Dani Ramirez

  committed
  746788b

• Expanded explanation about issues when rendering binded parameters to carto queries.

  

  Dani Ramirez

  committed
  ba494a3

• Source folder renamed as longitude.

  

  Dani Ramirez

  committed
  78bc949

• Build + development environment switched to Poetry

  

  Dani Ramirez

  committed
  6566bb2

Commits on Feb 4, 2019

• Python requirement lowered to 3.6 or bigger instead of 3.7. Fixed coverage script for longitude path.

  

  Dani Ramirez

  committed
  1c43064

• First try with Jenkins + Poetry

  

  Dani Ramirez

  committed
  74773c5

Commits on Feb 5, 2019

• Updated data source base including some shortcut query methods and dataframe read/write abstract methods

  

  Dani Ramirez

  committed
  ca0d967

• Updated dependencies

  

  Dani Ramirez

  committed
  11029de

• Config reworked as in ch31846.

  Show description for ad0feb7
  

  Dani Ramirez

  committed
  ad0feb7