Askflow-gpt

Installation

git clone https://github.com/KlukvaTech/askflow-gpt.git
huggingface-cli download TheBloke/openchat-3.5-0106-GGUF openchat-3.5-0106.Q4_K_M.gguf —local-dir . —local-dir-use-symlinks False
Переместить вашу модель в папку models.
Задать переменные в .env

LLM_NAME=llama.cpp
VITE_API_STREAMING=false
EMBEDDINGS_NAME=huggingface_sentence-transformers/all-mpnet-base-v2

Запуcтить всё в докере - файл run-with-docker-compose.sh
Запуcтить локальный бэкэнд - файл setup-local-back.sh
Запуcтить локальные фронт и бэк - файл setup-local-back.sh + setup-local-front.sh

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
application		application
frontend		frontend
mock-backend		mock-backend
scripts		scripts
LICENSE		LICENSE
README.md		README.md
docker-compose-azure.yaml		docker-compose-azure.yaml
docker-compose-dev.yaml		docker-compose-dev.yaml
docker-compose-local.yaml		docker-compose-local.yaml
docker-compose-mock.yaml		docker-compose-mock.yaml
docker-compose.yaml		docker-compose.yaml
package-lock.json		package-lock.json
package.json		package.json
run-with-docker-compose.sh		run-with-docker-compose.sh
setup-local-back.sh		setup-local-back.sh
setup-local-front.sh		setup-local-front.sh
setup.sh		setup.sh
test.sh		test.sh