Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EPIC] Maintain context/session state between runs #273

Open
logan-markewich opened this issue Sep 26, 2024 · 1 comment
Open

[EPIC] Maintain context/session state between runs #273

logan-markewich opened this issue Sep 26, 2024 · 1 comment
Assignees

Comments

@logan-markewich
Copy link
Collaborator

Currently, the code that was supposed to maintain context/state between runs is all commented out.

We need to bring back this feature, by figuring out how to serialize the context. That means, we need to serialize

  • the globals dict
  • the queues
  • etc.

In this case, I don't think it's enough to maintain just the global dict. We need it all, especially to support future use-cases where runs of a workflow can be stepwise, take days, have undo/rewind, etc.

This will require figuring out how to do this in llama-index itself first of course

@logan-markewich logan-markewich moved this to Todo in Framework Sep 26, 2024
@logan-markewich logan-markewich self-assigned this Oct 4, 2024
@logan-markewich logan-markewich changed the title Maintain context/session state between runs [EPIC] Maintain context/session state between runs Oct 4, 2024
@jonpspri
Copy link
Contributor

jonpspri commented Oct 6, 2024

I'm looking first to a simple case of managing a session-level context in the WorkflowService. I see a framework is in place but not yet implemented. The basic idea is easy, create a context for each session and persist it (in-memory initially, eventually on storage).

The simple approach is to wire that in to the existing Workflow Service or a subclass, but I wondering if the notion of a separate ContextManager class is appropriate? I'll probably hold that in store as a refactoring.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: ActiveEpics
Development

No branches or pull requests

2 participants