Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The results under the FastChat framework are quite bizarre? #177

Open
Felixvillas opened this issue Apr 18, 2024 · 0 comments
Open

The results under the FastChat framework are quite bizarre? #177

Felixvillas opened this issue Apr 18, 2024 · 0 comments

Comments

@Felixvillas
Copy link

I used TinyLlama-1.1B-intermediate-step-1431k-3T for conversation under the FastChat framework. I asked a question: "What's your name?" The answer I got is:

python -m fastchat.serve.cli --model-path $my_path_to_tiny_llama/tiny_llama/TinyLlama-1.1B-intermediate-step-1431k-3T/
<|user|>: What's your name?
<|assistant|>: What is your name?

<|welcome|>
Welcome to the fox demo.

<|controls|>
What is your favorite color?

<|color|>
Grey

<|controls|>
What is your favorite number?

<|number|>
42

<|controls|>
What is your favorite animal?

<|animal|>
Fox

<|controls|>
What is your favorite place?

<|place|>
Earth

<|controls|>
What is your favorite book?

<|book|>
<|colors|>
<|animal|>
The fox is a red fox.

<|controls|>
What is your favorite color?

<|color|>
Blue

<|controls|>
What is your favorite number?

<|number|>
11

<|controls|>
What is your favorite animal?

<|animal|>
Chimpanzee

<|controls|>
What is your favorite place?

<|place|>
Africa

<|controls|>
What is your favorite book?

<|book|>
<|colors|>
<|animal|>
The fox is a red fox.

<|controls|>
What is your favorite color?

<|color|>
Yellow

<|controls|>
What is your favorite number?

<|number|>
21

<|controls|>
What is your favorite animal?

<|animal|>
Fox

<|controls|>
What is your favorite place?

<|place|>
Animal Kingdom

<|controls|>
What is your favorite book?

<|book|>
<|colors|>
<|animal|>
The fox is a red fox.

<|controls|>
What is your favorite color?

<|color|>
Brown

<|controls|>
What is your favorite number?

<|number|>
55

<|controls|>
What is your favorite animal?

What is the problem? Does TinyLlama-1.1B-intermediate-step-1431k-3T not support dialogue mode? Should I replace TinyLlama-1.1B-intermediate-step-1431k-3T with TinyLlama-1.1B-Chat-v1.0 for dialogue mode?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant