[Feature Request] 允许自定义生成聊天标题的模型

[jiangying000]

🥰 Feature Description

比如用o1聊天，用4o-mini生成标题。4o-mini和o1比价格变为1/100

🧐 Proposed Solution

加个生成聊天标题的模型选项，max_token 设置为200，定死就行

📝 Additional Information

No response

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Title: [Feature Request] allows customizing the model for generating chat titles

🥰 Feature Description

For example, use o1 to chat and 4o-mini to generate titles. The price of 4o-mini and o1 becomes 1/100

🧐 Proposed Solution

Add a model option for generating chat titles, set max_token to 200, and it will be dead.

📝 Additional Information

No response

[QAbot-zh]

允许的，在这里：

[jiangying000]

允许的，在这里：

这个感觉不太清晰，可以补充下：也作为标题生成模型

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Allowed, here:


This doesn’t feel very clear, so I can add: It can also be used as a title generation model.

[QAbot-zh]

嗯你说的对

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Well you are right

[jiangying000]

另外有个必现的bug， 我如果把模型设置为：o1-mini
max token 设置为 32768

压缩模型设置为 4o mini

聊天2次，标题生成错误：{ "error": { "message": "max_tokens is too large: 32768. This model supports at most 16384 completion tokens, whereas you provided 32768. (request id: )", "type": "invalid_request_error", "param": "max_tokens", "code": null }}

[QAbot-zh]

对话标题生成错误的问题已经在着手解决了，对于这类错误将不替换标题名称： #5579

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

The problem of incorrect conversation title generation is already being resolved. For such errors, the title name will not be replaced: #5579

[jiangying000]

对话标题生成错误的问题已经在着手解决了，对于这类错误将不替换标题名称： #5579

建议生成标题时直接定死max completion token = 300，就不会错了

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

The problem of incorrect conversation title generation is already being resolved, and the title name will not be replaced for such errors: #5579

It is recommended to directly set max completion token = 300 when generating the title, and you will not be wrong.

[jiangying000]

不替换标题名称

这个方案不好

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Do not replace title name
This plan is not good

[QAbot-zh]

不替换标题名称

这个方案不好

修改 max_tokens 仅仅是适配你 o1 遇到的问题，实际上属于你调用模型的设置参数不正确，并不能彻底解决标题生成错误这类问题，别人使用其他模型也可能遇到各种标题生成报错。前述 pr 想解决的是标题不被错误消息污染的问题。
当然内置一个默认合理的 max_tokens 我觉得也是有意义的。

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Do not replace title name

This solution is not good

Modifying max_tokens is just to adapt to the problem you encountered with o1. In fact, the setting parameters of the model you called are incorrect, and it cannot completely solve the problem of title generation errors. Others using other models may also encounter various title generation errors. The aforementioned PR solves the problem of titles not being polluted by error messages.

[jiangying000]

不替换标题名称

这个方案不好

修改 max_tokens 仅仅是适配你 o1 遇到的问题，实际上属于你调用模型的设置参数不正确，并不能彻底解决标题生成错误这类问题，别人使用其他模型也可能遇到各种标题生成报错。前述 pr 想解决的是标题不被错误消息污染的问题。 当然内置一个默认合理的 max_tokens 我觉得也是有意义的。

1. 我的参数设置是对的
2. 别人使用其他模型也可能遇到各种标题生成报错，用我说的方案 【直接定死max completion token = 300】 基本上能解决绝大多数的吧，还有什么其他原因呢？

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Do not replace title names

This solution is not good

Modifying max_tokens is just to adapt to the problem you encountered in o1. In fact, the setting parameters of the model you called are incorrect, and it cannot completely solve the problem of title generation errors. Others using other models may also encounter various title generation errors. . The aforementioned PR wants to solve the problem of titles not being polluted by error messages. Of course, I think it also makes sense to have a built-in default reasonable max_tokens.

1. My parameter settings are correct
2. Others using other models may also encounter various title generation errors. The solution I mentioned [directly setting max completion token = 300] can basically solve most of them. What other reasons are there?

[QAbot-zh]

包括但不限于图中错误：
#5579 (comment)

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Including but not limited to errors in pictures:
#5579 (comment)

[jiangying000]

包括但不限于图中错误： #5579 (comment)

明白，谢谢

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Including but not limited to errors in the figure: #5579 (comment)

Got it, thank you

[QAbot-zh]

当然标题生成错误时是否应该替换，也是之前作者决定不更改默认标题的（ #5494 ），前述pr只是想在当前解决方案下覆盖多一些错误类型。但鉴于目前已经增加手动重新生成标题的功能了，让错误输出在标题处未尝不是一种鲜明的提醒 😂

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Of course, whether the title should be replaced when an error is generated is also the author's previous decision not to change the default title (#5494). The aforementioned PR just wants to cover it under the current solution. More error types. But since the function of manually regenerating the title has been added, having the error output in the title is a clear reminder 😂