How to use Llama3.java with Spring AI or Langchain4j? #23
-
|
Thanks so much for developing this project. I don't understand how to actually use it from my spring boot project? How can I use with with Spring AI, for example? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Hi @LiveNathan, it all started as a fun weekend project and I think succeeded as that; in its current form you can fork it and use is as you see fit. |
Beta Was this translation helpful? Give feedback.
Hi @LiveNathan, it all started as a fun weekend project and I think succeeded as that; in its current form you can fork it and use is as you see fit.
I'm working on a library to provide fast LLM inference engine for Java, with simple, beautiful APIs; support for more models and quantizations, and maybe GPUs ... but it will take me some time, I'll start releasing it some components, one at the time e.g. GGUF file format library, tokenization library, an inference API, then different models, different backends ...