Wenxi Zhang Concept

Product concept

Muse, off the phone.

What if my personal agent could come with me through a real workday — and see what I see?

A hand holding a pair of smart glasses; a floating panel reads “Muse Connected.”
Glasses paired with Muse · AI-generated

01

Where it started

I use a lot of AI tools. Each one knows a slice of my day, and none of them know each other. So I became the bridge: copying notes, re-explaining context, keeping a running markdown file just so the next tool could catch up.

When Meta launched Muse this month, I set up my own agent — I named it Ziggy — and it became the place my day comes together. Then I tried Meta’s glasses in the store, and they connected to a different assistant. Two products I liked, two separate experiences. That’s where this concept starts — not from a strategy deck, from my own day.

02

A workday, mapped

I mapped one ordinary workday and marked every moment where context had to move. Three kinds of handoff kept showing up.

Workday map from 7 AM to 7 PM: six keyframes, each marking where context moves between devices, tools, and work and personal agents.
Workday map, designed in Figma · Tap to open full size

  1. 07:00

    Across devices

    One voice session follows me from phone to glasses and holds through the pauses. No re-waking it every time I put the phone down.

  2. 09:30

    Between work and personal

    When a meeting ends, I pick what crosses over. Only the to-do goes — a title and a due time, never the file.

  3. 19:00

    Across tools

    Everything the day produced lands in one evening briefing: what’s done, what carries over, what I promised.

03

Three principles

1

No setup moment.

Put the glasses on and your agent is already there. The glasses unlock it, launch it, and drive it — no re-pairing, no bouncing between apps.

2

A tap, not a wake word.

Say nothing. Tap once for Voice mode, twice for Vision mode. It works in a quiet office or mid-conversation, and nobody around you hears a command.

3

The camera waits. The voice can nudge.

Vision mode only turns on when you ask for it, every time. Voice mode is allowed to reach out first — a heads-up before the next meeting, a nudge when it’s time to leave.

04

Field note: a visit to the Meta store

On September 22, I went to the Meta store to try the glasses myself. The hardware was simple and well made: a clean voice experience, and photo and video capture that felt effortless.

A few small details I’d tune right away. Every AI interaction starts with “Hey Meta” — natural on a street, less so in a quiet store or an open office, where I’d rather not announce to the room that I’m talking to my glasses. And the glasses pair with the Meta AI app, while my agent lives in Muse; in the store, I couldn’t get connected to try the AI side at all.

Walking out, one question stuck with me: I already trust my agent with my day. What if it could see it, too?

Kiosk demo screen: “Start by saying: Hey Meta, start live translation.”
01 Live translation demo — it starts with “Hey Meta”
Kiosk screen: “Press the capture button on the right arm to take a photo.” Glasses on display in the background.
02 Capture is one button on the right arm
Kiosk screen showing photos taken on the glasses during the visit.
03 Shots taken on the glasses, reviewed on the kiosk
Kiosk screen titled “Meta AI companion app,” noting the app is required to activate the glasses.
04 The glasses activate through the Meta AI app

05

What if my agent could see what I see?

Glasses as an input, not a new app. The glasses stay as simple as they are today. My personal agent is the brain behind them.

Tap
Voice mode — talk to your agent, hands-free.
Double tap
Vision mode — look at a document, and your agent reads it with you.
No glasses?
The same control lives in the agent’s app: start Voice, or open Vision with the phone camera.

The point isn’t the glasses. A personal agent should show up wherever my attention is — face, phone, or neither.

Phone screen of the agent app: after the user taps Allow, a live Voice mode call with the agent stays open while they keep typing.
No glasses: one tap on the phone starts the same Voice mode call · Concept UI
Glasses in hand with a panel reading “Muse Connected.”
01 Connected · AI-generated
A person taps the arm of the glasses; caption reads “Tap to activate Voice Mode, double tap for Vision Mode.”
02 Tap for Voice, double tap for Vision · AI-generated
A phone showing a voice call with the agent beside a person tapping the glasses; the glasses button mirrors the control to the phone.
03 The same control, mirrored on the phone · AI-generated
View through the glasses at a desk of papers; an overlay says Vision mode is on and the agent is analyzing the document.
04 Vision mode reads a document with me · AI-generated

Frames use Muse as the example agent.

06

Trust, first

If the flow feels natural, people keep using it. If they keep using it, trust has room to grow. That loop is the whole bet — and it can’t be skipped.

A personal agent is a lot like a new friend. You don’t hand over your calendar on day one.

  1. Stage 1

    Meet

    It says who it is, what it can see, and what it can’t. Permissions start small and stay explicit.

  2. Stage 2

    Get to know each other

    It learns my routines from what I choose to share. I can see what it remembers and delete it. Scans land in my files, and only what I asked about is kept.

  3. Stage 3

    Trust, for the long run

    Once it’s earned, it gets more room: proactive nudges, work to-dos I send over myself, and a camera I’m fine using in public — capture light on, bystanders’ faces blurred on-device.

There are likely good reasons this isn’t shipped yet — battery, privacy review, sequencing. From the outside, this is the version I’d want to test.

07

What I’d build first

Not the glasses. The smallest thing worth testing is the 09:30 handoff: one “Send to my agent” button in a work tool that passes a to-do across — a title and a due time, nothing else.

Repeat use
Do people still press it in week two?
Follow-through
Do they open the to-do on the personal side?
Trust
How many turn it off — and why?

If that holds, voice and vision are the next surfaces. If it doesn’t, no hardware will fix it.