Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

o1-mini: unsupported parameter #473

Open
redquixote opened this issue Oct 17, 2024 · 1 comment
Open

o1-mini: unsupported parameter #473

redquixote opened this issue Oct 17, 2024 · 1 comment

Comments

@redquixote
Copy link

Firstly, thanks for this magnificient plugin.

I've been trying to use the o1-mini model but I get the following error:

Unsupported parameter: 'max_tokens' is not supported with this model. Use 'max_completion_tokens' instead.

I changed the configuration to add max_completion_tokens but it seems that the max_tokens is sent in the request.

anyone with similar issue?

@v3ceban
Copy link

v3ceban commented Nov 21, 2024

Just tried using o1/o1-mini, faced the same problem.

Though my understanding of lua and nvim plugins ecosystem is limited, I believe that local configs for plugins override existing entries in plugins default tables, but still use default values for anything that is not present in the override.

After a quick look at the source code, it looks that max_tokens is a default parameter, hence is always present in request.

So far only o1-preview and o1-mini seem to be affected. But they are also still in beta and might change behavior in release version.

Still, though, is there any way to change request parameters based on model name? Or completely delete default config and send out your own parameters?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants