Use your locally running AI models to assist you in your web browsing
-
Updated
Dec 20, 2025 - TypeScript
#
localllm
Here are 141 public repositories matching this topic...
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
-
Updated
Dec 19, 2025 - Go
A generalized information-seeking agent system with Large Language Models (LLMs).
-
Updated
Jun 19, 2024 - Python
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
natural-language-processing text-generation transformer llama quantization model-compression efficient-inference post-training-quantization large-language-models llm small-models localllm
-
Updated
Aug 13, 2024 - Python
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
natural-language-processing compression text-generation transformer llama quantization mistral model-compression efficient-inference efficient-model large-language-models llm small-models localllm localllama
-
Updated
Aug 13, 2024 - Python
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
-
Updated
Nov 27, 2025 - TypeScript
A flexible, AI powered C2 framework built with operators in mind
rust ai quic http3 c2 redteaming command-and-control redteam implant postexploitation c2-framework localllm ollama-app redteaming-tools redhex openwebui
-
Updated
Dec 18, 2025 - TypeScript
The PyVisionAI Official Repo
python open-source ocr computer vision openai llama vlm vision-models localllm ollama claude-3-5-sonnet
-
Updated
Jul 19, 2025 - Python
MVP of an idea using multiple local LLM models to simulate and play D&D
dnd local multiagent streamlit llm localllm local-ai ollama multi-llm llm-generator ollama-python multi-ai llm-game ai-dnd
-
Updated
Apr 23, 2025 - Python
Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on different ports and loading/unloading them on demand
-
Updated
Dec 16, 2025 - Go
Fenix Ai Trading Bot with LangGraph and ollama and multipe providers
-
Updated
Dec 9, 2025 - Python
Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.
-
Updated
Dec 3, 2025 - TypeScript
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
self-hosted mlx openai-api llm llamacpp llama-cpp vllm llm-inference localllm localllama llama-server llm-router mlx-lm
-
Updated
Dec 18, 2025 - Go
Vesta macOS Distribution - Official releases and downloads.Vesta AI Chat Assistant for macOS - Built with SwiftUI and Apple Intelligence using Apple's on device model on MacOs Tahoe (MacOS 26). Now with side-by-side Qwen3-VL for vison
macos chat apple ai neural-networks lora chat-application tahoe localllm finetuning-llms appleintelligence privateai apple-llm apple-llm-integration applefoundationalmodels qwen3-vl
-
Updated
Dec 16, 2025
A Cli, a webUI, and a MCP server for the Z-Image-Turbo text-to-image generation model (Tongyi-MAI/Z-Image-Turbo base model as well as quantized models)
python apple ai cuda webui lora mps text-to-image text2image apple-silicon diffusers localllm mcp-server z-image-turbo z-image
-
Updated
Dec 19, 2025 - Python
Improve this page
Add a description, image, and links to the localllm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the localllm topic, visit your repo's landing page and select "manage topics."