Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

An awesome repository of local AI tools

A natural language interface for computers

MLX: An array framework for Apple silicon

Examples in the MLX framework

An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Universal LLM Deployment Engine with ML Compilation

Interact with your documents using the power of GPT, 100% privately, no data leaks

Start a server from the MLX library.

⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

LLM training in simple, raw C/CUDA

MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone