I'm a designer, not a programmer. I built a Mac app with Claude Code so I can draw on my app and have Claude fix that spot
retained text
Designer here, building apps with Claude Code. The part that always drove me nuts was explaining where. "Delete the third line of text under the second card." "Move the icon to the left edge, 24px margin." Screenshots with circles work, but then you're screenshotting, marking up and pasting all day. Playwright MCP helped a lot. But I kept thinking: what if I could just draw on the screen Playwright is looking at, and Claude gets it? So I built SKETCHTALK, another MCP server. It's a Mac app that previews whatever you're building (web pages, the iOS Simulator, a plugged-in iPhone, any Mac window), and you can still click and type in it. You draw on it, tell Claude what you want, and the result shows up in the preview. Claude Code wrote all of the code. I'm not a programmer, so it was basically me looking at the screen and saying "change this" over and over. Once it was usable, I started building my other apps with it and fed what I ran into back into SKETCHTALK. Some things I learned: It started out as just "send a screenshot faster". Then I made it pass along the element under each mark on web pages (which heading, which file and line). Claude picks the wrong spot way less now. I first had a chat built into the app. That didn't work for me because I usually have several chats going at once. Making it plain MCP tools was way better. It also works as a back-and-forth screen. I had Claude make a bunch of item images, then just ticked checkboxes to tell it which ones to keep and which to drop. 10 marks a day are free. Unlimited Ink is a one-time $6.99 until Nov 16 ($9.99 after). If you don't draw marks and just let Claude use the preview, it's free. Mac App Store: https://apps.apple.com/us/app/sketchtalk-draw-to-ai/id6823101740?mt=12&pt=128645013&ct=reddit Not affiliated with Anthropic.
document fetched 2026-11-08 00:33 · canonical https://reddit.com/r/ClaudeCode/comments/1xpw4m4/im_a_designer_not_a_programmer_i_built_a_mac_app