# I built a voice AI chief of staff that runs off my Obsidian vault. What would you make it do? — retained record

> Retained reddit record from reddit:AI_Agents.

Canonical: https://highsignal.app/data/records/9401e04fd20545ae

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:AI_Agents)  published 2026-10-20 11:06 ingested 2026-10-21 02:35

[original source ↗](https://www.reddit.com/r/AI_Agents/comments/1xap74s/i_built_a_voice_ai_chief_of_staff_that_runs_off/)

## retained text



```
&#x200B;

I've been building a personal AI I talk to out loud. I call it Jarvis. It isn't a smarter model than anyone else's, it's the same kind you can use. The difference is what's wrapped around it.  

  

It has hands: it works on my real files and tools, so it does the job instead of just advising me. It has memory: everything lives in an Obsidian vault, so nothing gets crammed into a context window, and it looks things up when it needs them. And it has structure: the vault is organized so it can pu  

  

What it can do: read and write my notes, search them by meaning, build small apps and sites on request, take actions on my machine, check its own health, and talk to me by voice.  

  

What it can't do: change its own code or settings without my say-so, take any action I haven't allowed, or be trusted blindly. It can be wrong, and it tells me when it isn't sure.  

  

What it struggles with, as of today: speech-to-text mangles words, so it sometimes answers the wrong question. Its voice stayed on my old speakers after I switched Windows audio. It couldn't open a note in Obsidian through its normal connection because a permission was missing, and it had to route a  

  

So I want to push it further, and I need ideas from people who aren't me:  

  

1. What's one recurring task you'd hand to something like this?  

2. What access or context would it need to do it well?  

3. What failure would make you stop trusting it?  

  

If you try something similar, tell me what worked and what fell on its face. I'll post what I learn.
```



document fetched 2026-10-21 00:19 · canonical https://reddit.com/r/AI_Agents/comments/1xap74s/i_built_a_voice_ai_chief_of_staff_that_runs_off
