AON is a self-hosted AI agent that runs on your own hardware with local models. It answers
questions, runs tools (files, shell, web search, maps), remembers you across chats, reads your
documents, and extends itself with new models, skills and MCP servers. Use it from the web, the
Android app, Telegram, or from Claude Desktop, Claude Code and Cursor through its
MCP server.
IMPORTANT
🔒 Nothing leaves your box. Chat runs on vLLM or
Ollama on your own GPU, embeddings on Ollama. No cloud LLM, no API bills,
no provider filtering or logging.
⚡ Quick start
pipx install aon-agent
aon init
aon serve
TIP
You need Ollama with nomic-embed-text and a chat model that supports
tools: ollama pull nomic-embed-text && ollama pull qwen3:14b. Then try aon mcp to plug AON
into Claude Desktop (how).
💡 Why AON
Memory and RAG are table stakes now. What AON adds:
- 🔓 Obliterated and fully yours. An uncensored ("obliterated") 27B model on a single consumer
GPU (RTX 4090). Your chats, memory and documents never leave the box.
- 🧬 It extends itself. Paste a link and AON works out what it is: a GGUF model it can pull
(it checks the VRAM budget and tool support first), an MCP server it can connect, a skill repo
it can import, or docs it can learn from. It can draft a new skill from any web page and test it.
- 🔌 Plugs into the AI apps you already use.
aon mcp turns AON into an MCP server for
Claude Desktop, Claude Code and Cursor, so they can hand it tasks and search its memory and your
documents.
- 👥 A private AI for your whole crew, from one GPU. vLLM serves several people at once,
behind Cloudflare Access email PIN, with every user approved by hand.
- 🛡️ Honest by design. Shell commands and file writes wait for your approval. A reply that
claims "done" without a tool having run is not trusted. Secrets are never saved to memory.
- 🗺️ Grounded, not guessed. Places and routes come from OpenStreetMap routing on a 3D globe;
distances and times are computed, not written by the model.
| 🛰️ AON | ☁️ Typical cloud AI chat |
|---|
| Runs on your own hardware | ✅ | ❌ |
| Your chats and files stay with you | ✅ | ❌ |
| Provider content filtering | ❌ none | ✅ |
| Cost | your GPU's power | subscription or per token |
| Long-term memory + your documents (RAG) | ✅ | ✅ |
| Runs commands on your server (with your approval) | ✅ | ❌ |
| Installs new models, MCP servers and skills from a link | ✅ | ❌ |
| Usable from Claude Desktop / Cursor as a tool (MCP) | ✅ | ❌ |
| One GPU serves your whole team | ✅ | ❌ |
🔌 MCP server
Use AON inside Claude Desktop, Claude Code, Cursor and any other MCP client.
aon mcp runs AON as a Model Context Protocol server. It ships
in the aon-agent package
(source); your MCP client starts it for you.
| Tool | What it does | Access |
|---|
ask_aon | Hand AON a task or question; it answers with its own model, memory, documents and tools. Pass chat to continue a conversation. | ✍️ write |
search_memory | Search AON's long-term memory about you | 👀 read |
remember | Save a fact to AON's memory | ✍️ write |
search_documents | Search your document library by meaning and exact words | 👀 read |
list_documents | List the library | 👀 read |
add_document | Add a text document to the library | ✍️ write |
NOTE
Shell commands and file writes are always refused over MCP: there is nobody to approve them
inside another app.
Claude Desktop and Cursor
- Claude Desktop: Settings →
Developer → Edit Config (
claude_desktop_config.json), then restart it.
- Cursor:
~/.cursor/mcp.json, or .cursor/mcp.json in a project.
{
"mcpServers": {
"aon": { "command": "aon", "args": ["mcp"] }
}
}
Claude Code
Claude Code:
claude mcp add aon -- aon mcp
Add "--home", "/path/to/home" to args for a different home folder. If the client can't find
aon, use the full path from which aon.
🎬 Demo
▶️ Click to watch on YouTube
✨ Features
| |
|---|
| 🛠️ Agent with tools | Read, write and edit files, run shell commands, search and fetch the web, show maps. Commands and file writes ask for approval. |
| 🧠 Long memory | Facts about you, searched by meaning and merged when they change; recall of older turns from this and other chats by meaning and exact strings; a rolling summary plus a numbered outline of everything you asked. |
| 📚 Document library (RAG) | Text, code, Markdown, HTML, Word and PDF, from the Documents panel or chat attachments. Hybrid search (SQLite FTS5 + vectors); answers cite the document. |
| 📏 Context budget | Every request is fitted to the model's window using the server's exact token count, so long chats never overflow. |
| 🧩 Skills | Agent Skills (SKILL.md): import from a zip, GitHub URL or pasted text; draft one from a web page; run evals. |
| 🔌 MCP, both ways | Connects to stdio and HTTP MCP servers (browse the Glama directory in the Hub) and is an MCP server itself. |
| 📎 Attachments | Files and photos in chat; images go to vision models. |
| 🗺️ Maps | Places and routes from OpenStreetMap (Nominatim, OSRM) on a MapLibre 3D globe. |
| 👥 Multi-user | Chat on vLLM to serve several users at once; Cloudflare Access for sign-in. |
| 📱 Everywhere | Web UI, Android app and an optional Telegram bot. |
🏗️ Architecture
flowchart TB
subgraph clients["Clients"]
direction LR
W["🌐 Web UI"] ~~~ A["📱 Android"] ~~~ T["💬 Telegram"] ~~~ M["🤖 Claude / Cursor"]
end
S["🛰️ AON server · FastAPI + agent loop"]
subgraph backends["Behind AON"]
direction LR
TL["🛠️ Tools"] ~~~ DB[("🧠 Memory + docs")] ~~~ V["⚡ vLLM"] ~~~ O["🦙 Ollama"] ~~~ X["🔌 MCP servers"]
end
clients -- "HTTPS via Cloudflare Access, or MCP over stdio" --> S
S --> backends
Built with
📱 Android app
260 KB, Android 7.0 or newer.
- Open the link on your phone and download the APK.
- Allow installs from your browser when Android asks (Install unknown apps), then tap Install.
- Open AON and sign in with your approved email address (see Try the live instance).
The app opens https://aon.vulkron.uk by default. To use your own server, press Back in the
app and choose Change server, for example http://192.168.1.84:8700 on your home network.
The APK is signed (APK Signature Scheme v2, certificate CN=AON, O=Vulkron, C=GB); its SHA-256 is
on the release page.
🔑 Try the live instance
Access to https://aon.vulkron.uk is by approval only:
- 📝 Request access. Open an issue
titled Access request, saying who you are and what you would like to use AON for. Please do
not post your email address in the issue; the maintainer will reply and tell you how to send it.
- ⏳ Wait for approval. Requests are reviewed by hand. Once yours is approved, your email address
is added to the allowed list and the issue is closed with a note.
- ✅ Sign in. Open https://aon.vulkron.uk, enter the approved email address, and type the
one-time PIN that is emailed to you. The PIN sign-in is handled by Cloudflare Access.
WARNING
Access can be withdrawn at any time. The instance runs on private hardware with limited capacity:
please do not use it for anything illegal, for automated or bulk traffic, or to process other
people's personal data, and expect a short wait when several people are using it.
📦 Installation
Requirements
- Linux (runs on Ubuntu), Python 3.11 or newer.
- Ollama with an embedding model (
ollama pull nomic-embed-text) and a chat
model with tool support (for example ollama pull qwen3:14b), unless chat runs on vLLM.
- Optional: a GPU server running vLLM (
vllm/).
- Optional: Node.js 20 for
npx-based MCP servers.
Install
pipx install aon-agent
aon init
Everything AON keeps (config, chats, memory, documents, skills) lives in its home folder:
--home DIR, else $AON_HOME, else ~/.aon.
From source (for development)
git clone https://github.com/leo007-htun/AON.git && cd AON
python3 -m venv venv && venv/bin/pip install -e ".[test]"
venv/bin/aon init
⚙️ Configuration
aon init writes config.toml into the home folder; edit it to taste. Keep context_window
equal to vLLM's --max-model-len (or the Ollama model's context).
All config.toml keys
| Key | Meaning | Example |
|---|
ollama_base_url | Ollama's OpenAI-compatible endpoint (embeddings, and chat unless chat_base_url is set) | "http://localhost:11434/v1" |
default_model | Model used when the UI does not pick one | "qwen3:14b" |
workdir | The agent's workspace; chats and documents are stored here | "~/.aon/workspace" |
bind | Address and port of the web UI | "0.0.0.0:8700" |
max_steps | Tool calls allowed per request | 40 |
command_timeout | Seconds before a shell command is stopped | 120 |
always_ask | Extra tools that always need approval | [] |
embed_model | Embedding model on Ollama | "nomic-embed-text" |
context_window | The chat model's context length, in tokens | 16384 |
reply_reserve | Tokens kept free for thinking and the answer | 6144 |
history_tokens | Recent chat turns sent word for word | 5000 |
cross_chat_recall | Also recall relevant turns from your other chats | true |
chat_base_url | Optional separate chat backend (vLLM) | "http://gpu-box:8001/v1" |
chat_model | The model name served there; only this model goes to chat_base_url | "aon" |
chat_temperature, chat_top_p, chat_repetition_penalty | Sampling for the chat backend | 0.2, unset, 1.15 |
chat_vision | The chat backend model accepts images | true |
telegram_bot_token, telegram_allowed_chat_ids | Optional Telegram bot | "", [] |
🚀 Running
aon serve
aon serve --port 9000
aon --help
In the background
setsid nohup aon serve >> ~/.aon/aon.log 2>&1 < /dev/null &
pgrep -af '[a]on serve'
tail -f ~/.aon/aon.log
pkill -f '[a]on serve'
As a systemd service (starts at boot, restarts on failure)
sudo tee /etc/systemd/system/aon.service >/dev/null <<'EOF'
[Unit]
Description=AON agent
After=network-online.target
Wants=network-online.target
[Service]
User=ubuntu
Environment=AON_HOME=/home/ubuntu/.aon
ExecStart=/home/ubuntu/.local/bin/aon serve
Restart=always
RestartSec=5
[Install]
WantedBy=multi-user.target
EOF
sudo systemctl daemon-reload && sudo systemctl enable --now aon
journalctl -u aon -f
Change User, AON_HOME and the aon path (which aon) to match your setup.
⚡ Multi-user with vLLM
Ollama answers one request at a time for some models. To serve several users, run the chat
model on vLLM and point AON at it:
chat_base_url = "http://<gpu-box>:8001/v1"
chat_model = "aon"
default_model = "aon"
context_window = 16384
vllm/ has the systemd unit, the chat template and the exact package versions used.
Measured on one RTX 4090 (24 GB) with a 27B 4-bit model: 16K context serves 2–3 full-length
requests at once and the rest queue; 8K serves 4.
🌐 Remote access
AON has no login of its own. Keep bind on your LAN and, to reach it from outside, put it behind
an authenticating proxy, for example a Cloudflare Tunnel with Cloudflare Access (email PIN).
Geolocation in the map needs HTTPS.
🧪 Development
pip install -e ".[test]"
pytest -q
Project layout
| Path | What it is |
|---|
src/aon/cli.py | The aon command: init, serve, mcp |
src/aon/main.py | Builds AON from config.toml (shared by serve and mcp) |
src/aon/mcp_server.py | AON as an MCP server |
src/aon/web.py | FastAPI app: REST API and the chat WebSocket |
src/aon/engine.py | The agent loop (tool calls, approval, loop guard) |
src/aon/router.py | Planner: answer directly, ask, or plan tool steps |
src/aon/llm_client.py, backends.py | Model calls; Ollama or vLLM per model |
src/aon/context.py | Fitting requests into the context window |
src/aon/recall.py, summary.py | Chat recall, rolling summary, outline |
src/aon/memory*.py | Episodic memory, extraction, consolidation |
src/aon/docs.py | Document library (RAG) |
src/aon/skills.py, skill_*.py | Skills: store, import, authoring, evals |
src/aon/mcp_client.py, mcp_tools.py, hub.py | MCP servers and the Glama hub |
src/aon/tools/ | Built-in tools (files, shell, web, map) |
src/aon/static/ | Web UI (index.html), icons, fonts, map library |
src/aon/default_skills/ | Skills copied into a new home by aon init |
tests/ | Test suite |
specs/ | Design notes |
vllm/ | vLLM server setup |
💾 Data
AON keeps its data in its home folder: workspace/app.db (chats), workspace/docs.db (document
library), memory/episodes.db (memory) and workspace/uploads/ (attachments). This repository
includes a snapshot of them from 2026-10-14. A fresh install creates empty ones; to start clean,
delete them before the first run. The Glama API key is kept in .glama_key, which is git-ignored.
🤝 Contributing
Issues and pull requests are welcome. For anything bigger than a fix, please
open an issue first to talk it through. Run
pytest -q before sending a pull request.
📄 License
AON is released under the MIT License. © 2026 Sithu Htun (@leo007-htun).
Bundled third-party files keep their own licenses, included next to them:
CybercoreCSS (MIT),
MapLibre GL JS (BSD-3-Clause),
highlight.js (BSD-3-Clause), and the Exo 2, JetBrains Mono, Orbitron and Rajdhani fonts
(SIL Open Font License).
If AON is useful to you, give it a ⭐. It helps others find it.
⬆ Back to top
