Pantry AI Assistant

An AI assistant that helps manage a kitchen pantry.

This project is work in progress. So far, I have created a basic interface and connected an LLM which is run locally using Ollama. The LLM can answer queries with reference to the food items in the pantry. See below.

Chat.webm

Skills and technologies used.

• Ollama used to run open source large language model locally.
• Streamlit for main chat app and interface.
• Langchain for building the flow of interaction with the llm.
• SQLite3 for creating a simple database for a kitchen pantry.
• speech-recognition package for testing voice to speech.
• gTTs for testing text to speech.

Features

• Check whether an item is in the pantry via chat.
• Add/remove items to pantry via chat.
• View pantry in separate page.
• Get recipe suggestions based on ingredients from the pantry.
• Add/remove items to shopping list via chat.
• View shopping list in separate page.
• Add items using image recognition.
• Manage interactions with voice.
• Add more...

Notes

Homebrew installs needed for the project.

• ffmpeg
• portaudio