Skip to content
This repository has been archived by the owner on Jan 27, 2024. It is now read-only.

希望支持第三方API和设置速率限制 #39

Open
hubery055 opened this issue Jul 6, 2023 · 2 comments
Open

希望支持第三方API和设置速率限制 #39

hubery055 opened this issue Jul 6, 2023 · 2 comments

Comments

@hubery055
Copy link

大量封号之后，官方API很难获得，希望增加自定义URL的选项和限制每秒访问次数的限制以保证接口的稳定性。
@Raychanan
Copy link
Owner

目前已支持设置 num_threads. 默认为10，设置为 1 可能有助于缓解你所遇到的问题

@greatxin
Copy link

用OPENAI_API_BASE指定，用openai库发请求的都能用这个方法指定

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@hubery055 @greatxin @Raychanan