Skip to content

Commit

Permalink
feat: add codegeex4 prompt and upgrade to 0.2.82 llama-cpp.
Browse files Browse the repository at this point in the history
  • Loading branch information
codito committed Jul 13, 2024
1 parent a4a2621 commit 935bbf4
Show file tree
Hide file tree
Showing 2 changed files with 43 additions and 1 deletion.
42 changes: 42 additions & 0 deletions arey/data/prompts/codegeex4.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
# Prompt template for Gemma 2 models.
#
# See <https://huggingface.co/bartowski/codegeex4-all-9b-GGUF> and others.

name: codegeex4
version: 1
tokens:
system:
- message_text
- chat_history
- user_query
custom:
prompt_prefix: >-
You are an intelligent programming assistant named CodeGeeX. You will answer any questions users have about programming, coding, and computers, and provide code that is formatted correctly, executable, accurate, and secure, and offer detailed explanations when necessary. Please answer in English.
roles:
system:
message: |-
[gMASK] <sop> <|system|>
$prompt_prefix
assistant:
message: |-1
<|assistant|>
$message_text
user:
message: |-1
<|user|>
$message_text
stop_words:
- <|user|>
- <|assistant|>
- <|system|>
prompts:
chat: |
[gMASK] <sop> <|system|>
$prompt_prefix$chat_history <|user|>
$user_query <|assistant|>
task: |
[gMASK] <sop> <|system|>
$prompt_prefix <|user|>
$user_query <|assistant|>
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ description = 'Simple large language model playground.'
authors = [{ name = 'codito', email = '[email protected]' }]
dependencies = [
"click>=8.1.7",
"llama-cpp-python>=0.2.81",
"llama-cpp-python>=0.2.82",
"markdown>=3.5.2",
"ollama>=0.1.6",
"openai>=1.12.0",
Expand Down

0 comments on commit 935bbf4

Please sign in to comment.