Voice assistant
I added push-to-talk capture, streaming transcription and synthesized speech.
Native macOS AI assistant
Hey Peaky
A voice and text assistant that can inspect and operate apps.
SwiftSwiftUIAppKitAVFoundationAccessibility APICloudflare Workers
RoleProduct Designer
PlatformsmacOS
TypeNative macOS AI assistant
The overview
I built Peaky as a macOS menu-bar assistant for voice and text tasks. It captures speech, reads screen context and connects to an AI agent that can operate apps, with provider access through a Cloudflare Worker or local chat shim.
How it was made
- 01
Build for Mac
I built a native app for macOS 14.2 and later with Swift, SwiftUI, AppKit, AVFoundation and Accessibility APIs.
- 02
Capture context
I added push-to-talk voice capture, streaming transcription, multi-monitor screen capture and accessibility information.
- 03
Shape interface
I built a floating panel and a transparent full-screen overlay for the assistant.
- 04
Connect providers
I connected AI and transcription through a Cloudflare Worker proxy or local chat shim, using user-supplied API keys.
Key features
Screen context
I connected multi-monitor capture with accessibility information.
Assistant surfaces
I built a floating panel and a transparent full-screen overlay.
Provider connections
I connected AI and transcription through a Cloudflare Worker proxy or local chat shim.
A closer look
Every screen
Tools & stack
SwiftSwiftUIAppKitAVFoundationAccessibility APICloudflare Workers