Private · Offline · On-Device

Meet Muse
The AI that lives on your phone

A fully local, privacy-first AI assistant for Android. No cloud, no subscriptions, no data leaving the device — and when one phone isn't enough, your phones team up automatically.

Most AI apps rent you a brain. Muse is yours.

Every mainstream AI assistant — ChatGPT, Gemini, Copilot — sends your conversation to a server, processes it there, and sends a response back. Your words leave your device on every single message. Muse runs a full language model on the phone itself, so nothing ever travels over the internet.

🔒

Zero cloud exposure

Conversations stay on the device. No API keys, no accounts, no telemetry on your chats. Works in airplane mode.

⚡

Real-time on-device inference

Streaming token generation powered by llama.cpp, optimised with ARM NEON / fp16 / dotprod — same engine as desktop LLM runners, on your phone.

🌐

Mesh inference across phones

No model loaded? Another phone on the same Wi-Fi can answer for you — automatically discovered, automatically routed. No setup required.

🧠

Persistent memory

Muse remembers facts you tell it across sessions. It extracts, stores, and injects context automatically — like a note-taking app that's also the AI.

🎙️

Fully offline voice mode

Speech-to-text (Android SpeechRecognizer) and text-to-speech (Piper TTS) both run on-device. Voice chats work with no connection.

📸

Vision / multimodal

Gemma 4 vision support built in. Send a photo and ask a question — image encoding and token generation both run locally on the phone.

📲

Notification-aware AI

Muse can read incoming notifications and auto-reply — entirely on-device. The AI drafts the reply, you approve it.

⏰

Actions: reminders, timers, tasks

"Remind me in 2 hours" or "add milk to my shopping list" — Muse parses intent and creates alarms, timers, and tasks without any third-party app or internet.

🌍

Multi-language

Full UI localisation in English, French, Arabic (RTL), Russian, and Hindi. Language is switchable at runtime from settings.

Your phones become a compute cluster

This is the feature that has no equivalent in any other mobile AI app. When multiple phones are on the same Wi-Fi network, they discover each other automatically and share inference work — no pairing, no QR codes, no configuration.

How it works

  • ① Discovery — Phones advertise themselves via mDNS (Android NSD). The Orchestrator phone finds Worker phones within 1–5 seconds, with zero manual input.
  • ② Capability check — Each Worker reports its model name and tokens-per-second via a /capability endpoint. The Orchestrator picks the fastest matching peer.
  • ③ Secure dispatch — Prompt is sent over HTTP with a shared auth key. Tokens stream back as Server-Sent Events, identical to local generation from the user's perspective.
  • ④ Automatic fallback — If a Worker fails mid-stream, the job retries on the next available peer. If all peers are gone, it falls back to local inference.
  • ⑤ Health monitoring — Workers are pinged every 5 seconds. Stale peers are pruned from the registry automatically.

Role overview

🟢 Orchestrator

Any phone actively chatting. Always on. Discovers peers, dispatches jobs, handles fallback. No toggle needed — it's automatic.

🔵 Worker

A phone that opts in to share its GPU/CPU. One toggle in Settings. Registers on the LAN, accepts inference jobs from any Orchestrator peer.

📡 LAN Host

Exposes the full Muse chat interface over TCP port 8765 — for browser access or remote Lucy-to-Lucy chat. Separate from the mesh.

Phone A
Orchestrator
→
mDNS discovery
NSD / _lucyworker._tcp
→
Phone B
Worker (port 11435)
→
SSE stream
Tokens → Phone A

No other mobile AI app does all of this

There are excellent desktop LLM runners and cloud AI apps. There is nothing else that combines all of these capabilities on Android.

Capability Muse ChatGPT / Gemini Ollama (desktop) Jan (desktop) PocketPal AI
Runs on Android phone ✓ Yes ✓ Yes (cloud) ✗ Desktop only ✗ Desktop only ✓ Yes
Fully offline inference ✓ Yes ✗ Requires internet ✓ Yes ✓ Yes ✓ Yes
Zero data sent to cloud ✓ Yes ✗ All data sent ✓ Yes ✓ Yes ✓ Yes
Cross-device mesh inference ✓ Yes (auto) ✗ No ✗ No ✗ No ✗ No
Persistent memory across sessions ✓ Yes ~ Paid tier only ✗ No ✗ No ✗ No
Offline voice mode (STT + TTS) ✓ Yes ~ Cloud TTS ✗ No ✗ No ✗ No
Vision / image understanding ✓ Yes (on-device) ✓ Yes (cloud) ✓ Yes (desktop) ✓ Yes (desktop) ✗ No
On-device reminders / tasks ✓ Yes ~ Cloud-dependent ✗ No ✗ No ✗ No
Notification AI auto-reply ✓ Yes ✗ No ✗ No ✗ No ✗ No
No subscription / no account needed ✓ Yes ✗ Account required ✓ Yes ✓ Yes ✓ Yes
Model download + management in-app ✓ Yes N/A ✓ Yes ✓ Yes ✓ Yes

Built on proven open-source foundations

Muse doesn't reinvent inference. It wraps the same engine that powers desktop LLM runners — with Android-native integration built on top.

Inference engine

llama.cpp (JNI)
GGUF models
ARM NEON
fp16 / dotprod
SSE streaming
mtmd (vision)
Gemma 4 / 3n
Piper TTS

Mesh & networking

Android NSD (mDNS)
NanoHTTPD
OkHttp
SSE (port 11435)
TCP LAN (port 8765)
Shared-key auth

Android app stack

Kotlin
Jetpack Compose
Hilt (DI)
Room (SQLite)
MVVM + StateFlow
WorkManager
Foreground Services
FileProvider (SAF)
Firebase RC + Crashlytics
NotificationListenerService

Everything that's built and working

  • ✓Local LLM inference with streaming (llama.cpp JNI)
  • ✓Model download, resume, pause, integrity check, SAF import
  • ✓Text chat with full session history
  • ✓Memory system — automatic extraction and injection
  • ✓AI-driven actions: reminders, alarms, timers, tasks
  • ✓Voice mode — offline STT + Piper TTS
  • ✓Vision / multimodal — Gemma 4 E2B & Gemma 3n 4B (on-device)
  • ✓Notification listener + AI auto-reply
  • ✓Crash handler — JVM + native signal capture, crash report screen
  • ✓Mesh inference — zero-config peer discovery and job routing
  • ✓Mesh radar UI — live peer map with TPS, model, and tier
  • ✓LAN AI sharing — expose Lucy as an HTTP backend on local network
  • ✓Backup & restore via Android SAF
  • ✓Sampling presets — temperature, top-p, top-k per model
  • ✓Advanced settings — context length, threads, GPU layers
  • ✓App log + LAN traffic log screens (in-app debug)
  • ✓Multi-language UI (EN, FR, AR, RU, HI)
  • ✓Dark / light / system theme

What Muse never does

These are not marketing claims — they are architectural facts. There is no server to send data to because there is no server.

❌ Never sends your messages to a cloud server ❌ Never requires an account or login ❌ Never requires a subscription ❌ Never stores data outside your device ❌ Never needs internet to chat ❌ Never shares your conversations with anyone