Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model bark-small:fp16 already exists - Error loading GGUF models #294

Open
ekolawole opened this issue Nov 27, 2024 · 1 comment
Open

Model bark-small:fp16 already exists - Error loading GGUF models #294

ekolawole opened this issue Nov 27, 2024 · 1 comment
Assignees
Labels
🐞 bug Something isn't working

Comments

@ekolawole
Copy link

Issue Description

emmanuelkolawole@EmmanueacStudio ~ % nexaai run /Users/emmanuelkolawole/.cache/nexa/hub/official/bark-small/fp16.gguf
API request failed: 400 Client Error: Bad Request for url: https://model-hub-backend.nexa4ai.com/model/download-tag-folder
Failed to get download models: 400 Client Error: Bad Request for url: https://model-hub-backend.nexa4ai.com/model/download-tag-folder
Failed to pull model /Users/emmanuelkolawole/.cache/nexa/hub/official/bark-small/fp16.gguf. If you are using local path, be sure to add --local_path and --model_type flags.
Unknown task: None. Skipping inference.
emmanuelkolawole@EmmanueacStudio ~ % nexaai run --local_path /Users/emmanuelkolawole/.cache/nexa/hub/official/bark-small/fp16.gguf --model_type AUDIO
Error: For Audio models with --local_path, the provided path must be a directory containing all related files.
emmanuelkolawole@EmmanueacStudio ~ % nexaai run bark-small:fp16
Model bark-small:fp16 already exists at /Users/emmanuelkolawole/.cache/nexa/hub/official/bark-small/fp16.gguf
Error running ggml inference: TTS model is not supported in CLI mode.
Please refer to our docs to install nexaai package: https://docs.nexaai.com/getting-started/installation
emmanuelkolawole@EmmanueacStudio ~ % nexaai run bark-small:fp16 -st
Model bark-small:fp16 already exists at /Users/emmanuelkolawole/.cache/nexa/hub/official/bark-small/fp16.gguf
Error running ggml inference: TTS model is not supported in CLI mode.
Please refer to our docs to install nexaai package: https://docs.nexaai.com/getting-started/installation
emmanuelkolawole@EmmanueacStudio ~ % nexa run bark-small:fp16 -st
Model bark-small:fp16 already exists at /Users/emmanuelkolawole/.cache/nexa/hub/official/bark-small/fp16.gguf
Unknown task: TTS. Skipping inference.

Steps to Reproduce

CMAKE_ARGS="-DGGML_METAL=ON -DSD_METAL=ON" pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/metal --extra-index-url https://pypi.org/simple --no-cache-dir

Then run:
nexa run bark-small:fp16

emmanuelkolawole@EmmanueacStudio ~ % nexa run bark-small:fp16
Model bark-small:fp16 already exists at /Users/emmanuelkolawole/.cache/nexa/hub/official/bark-small/fp16.gguf
Error loading GGUF models, please refer to our docs to install nexaai package: https://docs.nexaai.com/getting-started/installation

OS

Sonoma 14.5

Python Version

3.11

Nexa SDK Version

0.0.9.5

GPU (if using one)

No response

@ekolawole ekolawole added the 🐞 bug Something isn't working label Nov 27, 2024
@unseenmars
Copy link
Collaborator

bark_cpp is temporarily disabled since version v0.0.9.3. We will provide more updates on this very soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐞 bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants