Description

• Langfuse credentials:

  • email: [email protected]
  • password: podflix123

• Chainlit credentials:

  • username: admin
  • password: admin

• To change db backend from postgresql to sqlite: Change in .env file ENABLE_SQLITE_DATA_LAYER=true

Cloning the Repository

To clone this repository including all submodules, use:

git clone --recurse-submodules https://github.com/yourusername/podflix.git

Update Submodules

make update-submodules

Healthchecks

• Assuming DOMAIN_NAME=localhost

Openai like model api

• Request with system message assuming MODEL_NAME=qwen2-0_5b-instruct-fp16.gguf

curl --request POST \
    --url https://llamacpp.localhost/v1/chat/completions \
    --header "Content-Type: application/json" \
    --data '{
  "model": "qwen2-0_5b-instruct-fp16.gguf",
  "messages": [
  {
      "role": "system",
      "content": "You are a helpful virtual assistant trained by OpenAI."
  },
  {
    "role": "user",
    "content": "Who are you?"
  }
  ],
  "temperature": 0.8,
  "stream": false
}'

• Request without system message assuming MODEL_NAME=qwen2-0_5b-instruct-fp16.gguf

curl --request POST \
 --url https://llamacpp.localhost/v1/chat/completions \
    --header "Content-Type: application/json" \
    --data '{
  "model": "qwen2-0_5b-instruct-fp16.gguf",
  "messages": [
  {
    "role": "user",
    "content": "Who are you?"
  }
  ],
  "temperature": 0.8,
  "stream": false
}'