Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

是否能支持sqlcoder系列模型 #310

Open
2496289471 opened this issue Jan 22, 2024 · 2 comments
Open

是否能支持sqlcoder系列模型 #310

2496289471 opened this issue Jan 22, 2024 · 2 comments

Comments

@2496289471
Copy link

实测sqlcoder2（基于starcoder）模型的速度比vllm快，但是输出内容与原版模型相差甚远，是否完全是因为不支持beam search的问题？
@hiworldwzj
Copy link
Collaborator

@2496289471 应该和beam search 关系不大，可能是模型细节不太一样，能不能提供一个huggingface 链接。后续更新一下。

@2496289471
Copy link
Author

@2496289471 应该和beam search 关系不大，可能是模型细节不太一样，能不能提供一个huggingface 链接。后续更新一下。

非常感谢，希望能早日更新。https://huggingface.co/defog/sqlcoder2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiworldwzj @2496289471