Jarvis — Local Desktop Assistant
Offline Windows assistant built with Tauri and a local Python engine — voice commands, app and file control, notes, reminders and audited actions.
Jarvis is a Windows desktop assistant with a Tauri, React and TypeScript shell over a local Python engine. Core deterministic commands work with no API key and no model downloads: voice activation or typed commands drive applications, keyboard shortcuts, typing, mouse control, window management and volume, while file create / copy / move / rename / recycle operations request confirmation before anything destructive runs. Offline speech recognition and local LLM chat are optional and require their model files to be installed. The runtime adds a validated configuration layer, a centralised policy boundary, registered tools with task and cancellation metadata, a separate audit database and AI provider contracts, shared by both the Tauri shell and the PyQt fallback.
Key Features
- Voice activation and typed command execution in a packaged Windows desktop app
- Application, window, mouse, keyboard and volume control
- File operations with confirmation prompts and an activity history
- Local notes, one-time reminders and filename search
- Optional offline Whisper speech recognition and local Qwen chat via llama.cpp
- Cooperative cancellation (Ctrl+Alt+Esc) across queued work and listening
- Separate audit database with allowlisted metadata and tightened file permissions
Repository Topics
Challenges
Coordinating desktop automation, voice input and a local model runtime behind an explicit policy boundary, with safe cancellation and clearly documented security limits.
Results
A staged Windows release with a shared local runtime, a documented architecture and a PyQt fallback — and an honest security section stating that owner authentication is not yet configured.