LLM and AI-Infused Applications with Java and Spring AI

Samples showing how to build Java applications powered by Generative AI and Large Language Models (LLMs) using Spring AI.

Pre-Requisites

• Java 23
• Docker/Podman
• Mistral AI API Key (optional)
• OpenAI API Key (optional)
• Ollama (optional)

Content

0. Use Cases

Project	Description
chatbot	Chatbot using LLMs via Ollama.
question-answering	Question answering with documents (RAG) using LLMs via Ollama and PGVector.
semantic-search	Semantic search using LLMs via Ollama and PGVector.
structured-data-extraction	Structured data extraction using LLMs via Ollama.
text-classification	Text classification using LLMs via Ollama.

1. Chat Completion Models

Project	Description
chat-models-mistral-ai	Text generation with LLMs via Mistral AI.
chat-models-ollama	Text generation with LLMs via Ollama.
chat-models-openai	Text generation with LLMs via OpenAI.
chat-models-multiple-providers	Text generation with LLMs via multiple providers.

2. Prompts, Messages, and Templates and Multimodality

Project	Description
prompts-basics-ollama	Prompting using simple text with LLMs via Ollama.
prompts-basics-openai	Prompting using simple text with LLMs via OpenAI.
prompts-messages-ollama	Prompting using structured messages and roles with LLMs via Ollama.
prompts-messages-openai	Prompting using structured messages and roles with LLMs via OpenAI.
prompts-templates-ollama	Prompting using templates with LLMs via Ollama.
prompts-templates-openai	Prompting using templates with LLMs via OpenAI.

3. Structured Output

Project	Description
structured-output-ollama	Converting the LLM output to structured JSON and Java objects via Ollama.
structured-output-openai	Converting the LLM output to structured JSON and Java objects via Open AI.

4. Multimodality

Project	Description
multimodality-ollama	Multimodality to include various media in a prompt with LLMs via Ollama.
multimodality-openai	Multimodality to include various media in a prompt with LLMs via OpenAI.

5. Function Calling

Project	Description
function-calling-mistral-ai	Function calling with LLMs via Mistral AI.
function-calling-ollama	Function calling with LLMs via Ollama.
function-calling-openai	Function calling with LLMs via OpenAI.

6. Embedding Models

Project	Description
embedding-models-mistral-ai	Vector transformation (embeddings) with LLMs via Mistral AI.
embedding-models-ollama	Vector transformation (embeddings) with LLMs via Ollama.
embedding-models-openai	Vector transformation (embeddings) with LLMs via OpenAI.
embedding-models-transformers	Vector transformation (embeddings) with LLMs via ONNX Sentence Transformers.

7. Data Ingestion

Project	Description
document-readers-json-ollama	Reading and vectorizing JSON documents with LLMs via Ollama.
document-readers-pdf-ollama	Reading and vectorizing PDF documents with LLMs via Ollama.
document-readers-text-ollama	Reading and vectorizing text documents with LLMs via Ollama.
document-transformers-metadata-ollama	Enrich documents with keywords and summary metadata for enhanced retrieval via Ollama.
document-transformers-splitters-ollama	Divide documents into chunks to fit the LLM context window via Ollama.

8. Vector Stores

Coming soon

9. Retrieval Augmented Generation (RAG)

Coming soon

10. Memory

Coming soon

11. Image Models

Project	Description
image-models-openai	Image generation with LLMs via OpenAI.

12. Audio Models

Project	Description
audio-models-speech-openai	Speech generation with LLMs via OpenAI.
audio-models-transcription-openai	Speech transcription with LLMs via OpenAI.

13. Moderation Models

Coming soon

14. Observability

Project	Description
observability-models-mistral-ai	LLM Observability for Mistral AI.
observability-models-ollama	LLM Observability for Ollama.
observability-models-openai	LLM Observability for OpenAI.
observability-vector-stores-pgvector	Vector Store Observability for PGVector.

15. Evaluation

Coming soon

16. Agents

Coming soon

References and Additional Resources

• Spring AI Reference Documentation

Conferences

• Introducing Spring AI by Christian Tzolov and Mark Pollack (Spring I/O 2024)
• Spring AI Is All You Need by Christian Tzolov (GOTO Amsterdam 2024)
• Concerto for Java and AI - Building Production-Ready LLM Applications by Thomas Vitale (Spring I/O 2024)

Videos

• Building Intelligent Applications With Spring AI by Dan Vega (JetBrains Live Stream)
• Spring AI Series by Dan Vega
• Spring AI Series by Craig Walls
• Spring AI Series by Josh Long

Demos

• Airline Customer Support (Marcus Hellberg)
• Composer Assistant (Thomas Vitale)
• Document Assistant (Marcus Hellberg)
• Flight Booking (Christian Tzolov)

Workshops

• Spring AI - Zero to Hero (Adib Saikali, Christian Tzolov)