Skip to content

LLM inference in C/C++, with Nexa AI's support for audio language model and swift binding

License

Notifications You must be signed in to change notification settings

NexaAI/llama.cpp

About

LLM inference in C/C++, with Nexa AI's support for audio language model and swift binding

Resources

License

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 57.3%
  • C 20.9%
  • Python 7.1%
  • Cuda 6.8%
  • Metal 2.7%
  • Objective-C 2.4%
  • Other 2.8%