Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

made server also support -cm --context_maximum input, and updated docs #158

Merged
merged 4 commits into from
Oct 10, 2024

Conversation

zhycheng614
Copy link
Collaborator

No description provided.

@zhycheng614 zhycheng614 requested a review from zhiyuan8 October 9, 2024 20:33
@zhycheng614 zhycheng614 changed the title Perry/customize nctx made server also support -cm --context_maximum input, and updated docs Oct 9, 2024
@zhycheng614 zhycheng614 marked this pull request as ready for review October 9, 2024 20:33
nexa/gguf/server/nexa_service.py Outdated Show resolved Hide resolved
CLI.md Outdated Show resolved Hide resolved
@zhiyuan8 zhiyuan8 merged commit a180e7c into main Oct 10, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants