Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] Limited Configurability with tiktoken Dependency or Caching #958

Closed
ThomasBury opened this issue Jul 29, 2024 · 2 comments · May be fixed by #962
Closed

[Question] Limited Configurability with tiktoken Dependency or Caching #958

ThomasBury opened this issue Jul 29, 2024 · 2 comments · May be fixed by #962

Comments

@ThomasBury
Copy link

I'm encountering a challenge when using Marvin due to its dependency on tiktoken. Tiktoken cannot currently pass request kwargs, for proxy, verify, etc. (required on enterprise networks)

While setting tiktoken to offline mode could be a potential solution, this approach is inconvenient for testing purposes.  

Is there a documented solution that I missed?

thank you
@zzstoatzz
Copy link
Collaborator

hi @ThomasBury - there's nothing you missed AFAIK

I think we could probably add an opt-in setting that saves the cache to the ~/.marvin directory - how does that sound?

@zzstoatzz zzstoatzz mentioned this issue Aug 11, 2024
Draft
@ThomasBury
Copy link
Author

That sounds great! Thank you for looking into this. Documenting this solution as a cookbook would be an excellent next step.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

add tiktoken cache PrefectHQ/marvin
2 participants
@ThomasBury @zzstoatzz