Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add local caching #24

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Add local caching #24

wants to merge 5 commits into from

Conversation

vavalomi
Copy link
Collaborator

@vavalomi vavalomi commented Jun 5, 2024

!!! WORK-IN-PROGRESS

These changes add support for local caching for the datasets as well as catalogs.

  • new, general-purpose, and transparent caching mechanism added via -datachache- command.
  • some of the existing approaches of locally stored data (specifically for catalogs) were switched to this new approach.
  • TODO: price data as well as latest catalogs are stored in mata matrices, so could be also transitioned to this.
  • TODO: no cache expiration procedures have been implemented yet. The only way to refresh currently is to manually delete local files.

TODO: there are parts of the system (within main datalibweb, as well as separate ado files) that may still make direct API calls and therefore not go through caching.

TESTING: as large parts of the code affecting logic were modified, testing needs to be done to identify broken workflows.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant