toolbini
AI ToolsNetwork ToolsThreat intelSave on AILearn AIAI Downloads
Sign in
AI ToolsNetwork ToolsThreat intelSave on AILearn AIAI Downloads
AI Downloads10
  • All AI tool downloadsnew
  • Free AI coding assistantsnew
  • Run LLMs locallynew
  • LLM red teaming toolsnew
  • Guardrails for LLM appsnew
  • Model, MCP and secret scannersnew
  • LLM evaluation toolsnew
  • LLM SDKs and frameworksnew
  • Free vector databasesnew
  • AI developer essentialsnew
  1. Home
  2. AI Downloads
  3. Run LLMs locally

Nothing is stored. No sign-up.

One useful email every Monday

New free tools, AI and network threats that matter, and one quick challenge. No spam, unsubscribe in one click.

Advertisement

Your brand here. Reach security teams, IT admins and AI builders.

Related tools

  • All AI tool downloadsFree and paid tools for developers, AI engineers and security testers.
  • Free AI coding assistantsCoding agents and editors that cost nothing or use your own key.
  • LLM red teaming toolsgarak, PyRIT, promptfoo and other AI security testers.
  • Guardrails for LLM appsNeMo Guardrails, LLM Guard, Llama Guard.
  • Model, MCP and secret scannersModelScan, mcp-scan, Gitleaks, Trivy and more.
Helped you? Share it with your teamXLinkedInWhatsAppReddit
Link to this tool

Found it useful? Paste this into your blog, wiki or runbook.

<a href="https://toolbini.com/ai/downloads/best/run-llms-locally/">Run LLMs locally</a>

Reviewed by the editorial team · Last reviewed 2026-11 · Report an error

Get the Monday drop ✨

Max one email a week: new tools, AI app policy changes, the weekly challenge and notable threats. No spam, ever.

AI Tools
  • Is this AI tool safe?
  • AI app risk tracker
  • Compare two AI apps
  • Shadow AI log analyzer
  • Risky extensions & MCP
  • AI threat feed
Network Tools
  • What is my IP?
  • Online privacy test
  • What is my local IP?
  • VPN before & after test
  • IPv6 test
  • Secure DNS check
Threat intel
  • IOC extractor
  • Defang / refang
  • Hash identifier
  • Phishing link checker
  • IOC lookup
  • AI vulnerability feed
Save on AI
  • 15 ways to cut token costs
  • Cheapest model for my task
  • API bill estimator & budget
  • AI subscription checker
  • Do I need a paid AI plan?
  • Free AI credits & student offers
Learn AI
  • Level 1: AI Fundamentals
  • Level 2: AI Builder
  • Level 3: Advanced AI
  • Best AI courses
  • Study planner
  • How an LLM writes a sentence
AI Downloads
  • All AI tool downloads
  • Free AI coding assistants
  • Run LLMs locally
  • LLM red teaming tools
  • Guardrails for LLM apps
  • Model, MCP and secret scanners
toolbiniPrivate by design: tools run in your browser and we never log what you paste.© 2026 Toolbini. Vendor-neutral; not affiliated with any security vendor.Privacy & cookiesAdvertiseBrowser extension

Free tools to run LLMs on your own computer

Download and run open-weight models with no per-token cost and no data leaving your machine.

How to choose

  • Easiest start: LM Studio (app) or Ollama (one command).
  • A ChatGPT-style web UI for a team: Open WebUI on top of Ollama.
  • Serving many users on GPUs: vLLM.

1. Ollama

Free

Ollama · macOS, Windows, Linux

Download and run open-weight models with one command; OpenAI-compatible API on localhost:11434.

2. LM Studio

Free

Element Labs · macOS, Windows, Linux

Desktop app to find, download and chat with local models, with a built-in OpenAI-compatible server.

3. Jan

Free

Jan · macOS, Windows, Linux

Open-source ChatGPT-style desktop app that runs models 100% offline.

4. GPT4All

Free

Nomic AI · macOS, Windows, Linux

Private desktop chat with local models and your own documents.

5. llama.cpp

Free

ggml-org · macOS, Windows, Linux

The C/C++ inference engine behind most local runners. Quantised models on CPU, Apple Silicon or GPU.

6. Open WebUI

Free

Open WebUI · Docker, Python

Self-hosted web interface for Ollama and OpenAI-compatible APIs, with RAG and multi-user support.

7. vLLM

Free

vLLM project · Linux (GPU)

High-throughput inference and serving engine for LLMs on GPUs, with an OpenAI-compatible server.

More lists

Best free AI coding assistantsFree LLM red teaming and AI security testing toolsOpen-source guardrails for LLM appsScanners for AI models, MCP servers and leaked keysFree LLM evaluation and observability toolsOfficial LLM SDKs and agent frameworksFree vector databases for RAGEssential tools for AI developers

How we keep this safe

  • We don’t host any files. Every download button goes to the maker’s official page or GitHub releases.
  • Versions, dates, licences and checksums come from GitHub’s API and refresh daily.
  • Before running a downloaded file, compare its SHA-256 checksum with the one shown on the tool’s page.
  • We’re independent and not affiliated with these vendors. If we ever earn from a link, the page will say so.