Cool Tools

A curated collection of tools unknown to many people

๐ŸŽจAI & Creative · Local & Offline AIOpen SourceFree
D

Dot

Chat with your own documents locally โ€” a free, open-source RAG app running small LLMs on your own machine, no data sent anywhere

Pricing:Free (open-source software)
License:GPL-3.0
Platform:macOS (Apple Silicon), Windows
Hosting:Desktop app (macOS/Apple Silicon or Windows, local models)
Account:Not required
Added:2026-10-14
Last verified:October 2026

Website: https://dotapp.uk/ ยท Source: GitHub ยท Type: Free open-source project (1.9k+ GitHub stars) by Alexander Pinel

Why it exists

"Chat with your PDFs" products all share a catch: your documents get uploaded to someone's server, where they become training-adjacent data or breach material. Dot's answer is blunt: run the whole loop โ€” embedding, retrieval, generation, even speech โ€” on your own machine, with a small local LLM and a local vector store. The result works offline, costs nothing, and the only place your spreadsheet has ever been is your computer.

Main features

  • Fully local RAG โ€” point Dot at folders (PDFs, spreadsheets, text), ask questions, get answers with the relevant chunks retrieved from your files; everything runs on-device, offline.
  • Small local models by default โ€” Phi-3.5 ships as the default (the choice of LLM is yours: Mistral and friends work too via llama.cpp); no API keys, no accounts, no egress.
  • "Big Dot" mode โ€” flip a switch to use the latest cloud Mistral models via API when the question is harmless and you want more horsepower.
  • Voice in and out โ€” speech-to-text and text-to-speech built in, so Dot works as a local, talking assistant.
  • Broad document support โ€” PDF, DOCX, PPTX, XLSX and more; load folders, ask questions, switch contexts โ€” the demo on the site covers component spreadsheets (prices, BOMs), drafting emails and follow-up questions across files.
  • Compact and hackable โ€” an Electron app small enough to understand (FAISS + LangChain + llama.cpp under the hood) โ€” a great codebase to learn local RAG from.

Who it's for

  • Anyone with documents they legally or morally can't upload: client NDAs, medical records, unreleased research.
  • Mac users on Apple Silicon (or Windows) with 8โ€“16 GB RAM who want to try local AI without Docker or terminal fu.
  • Developers wanting a readable, GPL reference implementation of local RAG + TTS + STT.
  • Journalists, lawyers and doctors in demo mode: the two-sentence pitch writes itself.

How it compares

  • Jan โ€” the bigger, actively-developed cross-platform local assistant with a model hub; Dot is the focused "chat with my files" tool and a simpler install.
  • LM Studio + documents โ€” LM Studio is a polished closed-source local model runner; Dot bakes the RAG layer in for you.
  • ChatGPT file uploads โ€” vastly stronger model, zero privacy; Dot's entire reason to exist is that trade.
  • PrivateGPT / localGPT โ€” similar open-source RAG projects; Dot ships as a real macOS app with voice, not a Python script.

Notes

  • Development has been quiet since late 2024 (the repo isn't archived, but don't expect fast fixes โ€” the maintainer is a student) โ€” the trade-off for a small, finished codebase.
  • Phi-3.5-class models are 2024-class: excellent for summarizing and locating facts in your files, not a GPT-5-class reasoner; Big Dot mode is the escape hatch.
  • Needs a reasonably modern machine (Apple Silicon or Windows); indexing speed and answer quality scale with available memory.
  • GPL-3.0, no telemetry, no account โ€” the privacy story is the architecture, not a policy.