DEV Community

I Control My Mac with Voice - Say Hey Jarvis and It Does Everything

What It Does

I built a voice assistant that controls 45 AI tools. I say "Hey Jarvis" and it executes.

Command Action
"generate content" Creates YouTube scripts for 9 channels
"research quantum computing" Deep research via Tavily + AI
"write email about meeting" Drafts email, copies to clipboard
"start focus" Starts Pomodoro + blocks apps
"code review" Reviews git diff with AI
"summarize" Summarizes clipboard content
"find file tax PDF" Natural language file search

Architecture

Mic โ†’ Whisper (offline) โ†’ Intent Classify โ†’ Router โ†’ Ollama โ†’ say (TTS)

Key Features

  • Offline speech (Whisper local)
  • Wake word: "Hey Jarvis"
  • Global hotkey: Ctrl+Space
  • Command chaining: "research AI then write blog"
  • Memory across conversations
  • Hindi + English

Setup

brew install portaudio
pip install SpeechRecognition pyaudio openai-whisper
python voice_commander_pro.py

๐Ÿ”— github.com/amrendramishra/ai-tools
๐ŸŒ amrendranmishra.dev

Comments

No comments yet. Start the discussion.