New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

使用DJL推理模型，部分文字乱码。 #9

Open

leleZeng opened this issue May 14, 2024 · 1 comment

leleZeng commented May 14, 2024

你好作者，我在使用djl环境下运行了Llama3-8B-Chinese-Chat-q4_0-v2_1.gguf模型，推理的结果部分单词会发生乱码，

我通过debug代码发现一个UTF8的字节数组拆成两个字节数组，正常'奋'的UFT8字节编码为[-27, -91, -117]。

Author

leleZeng commented May 14, 2024

我使用了TheBloke/Llama-2-7B-Chat-GGUF 的llama-2-7b-chat.Q5_K_S.gguf模型，输出的字符是正常的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment