A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

Distribute and run llamafile/LLMs with a single docker image.

AI Toolkit for Node.js (LLM, Image Generation, Embeddings, Vector Search)

Run AI workflows locally. Or deploy them anywhere. AI agent framework in YAML — workflow pipelines + autonomous agent loop. NVIDIA Inception member. Build, deploy, export as Docker/K8s/ISO.

Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge bases in one click, without complex configuration.

Create an IRC chat bot powered by AI, using llamafile, in minutes.

A simple github actions script to build a llamafile and uploads to huggingface

Serverless AI Inference with Gemma 2 using Mozilla's llamafile on AWS Lambda

Portable offline AI kit on a USB SSD — run LLM chat + Wikipedia + encrypted vault anywhere. No internet, no install, no subscriptions. Windows/macOS/Linux/Android/iOS. Powered by Qwen3 + llamafile.

This repository demonstrates LLM execution on CPUs using packages like llamafile, emphasizing low-latency, high-throughput, and cost-effective benefits for inference and serving.

API Proxy for AI models, rate limiting, management and more!

👾 Self-Healing AI Terminal Assistant — 100% local, offline-capable, privacy-first. Multi-tier LLM (llamafile/GGUF), auto-fix with FixNet consensus, 80+ commands. No cloud, no API keys needed.

An offline knowledge library on a USB drive. Wikipedia, Stack Exchange, Gutenberg, and Khan Academy, plus a local LLM that answers questions using those sources as context. Works on any computer, no internet required.

Gathering insights from Common Crawl using Apache Spark and LLMs.

Training materials on how to deploy generative AI models locally on your laptop or workstation.

Deterministic local-first AI operator runtime with receipts, replay, rollback, ranked memory, llamafile CPU driven execution, swappable intelligence cognition core, and sandboxed self-improvement.

UAE / Saudi LLM llamafile — Single-file, no-install executables for Falcon, Jais, ALLaM, and more.

Run Claude Code offline on Mac mini M4 — local Qwen3 via llamafile, OS-level sandbox via Safehouse, zero API cost.