
A chaotic, trial-and-error journey into automating something nobody asked me to automate.
I have a problem: I go to a boba or coffee shop, I order something incredible, and I customize it perfectly (less ice, 50% sweetness, oat milk). Three months later, I'm standing at the same counter with absolutely no idea what I ordered last time.
So I built a system to fix that.
The vision was simple: photograph the drink label that comes with my order, have my phone automatically parse it, and log it to a database I can query later.
The full pipeline looks like this:
Simple in theory. Deeply humbling in practice.
I built the Shortcut step by step with Claude's help. The basic flow was:
What sounds like six steps was actually about 40 actions in Shortcuts. And every single one had a gotcha.
Honestly, building in Shortcuts felt like giving instructions to someone who technically does exactly what you say but somehow always misunderstands you.
I also added a ❤️ rating to each log. The Shortcut shows a menu:
Each selection sets a variable to a number (5 through 1) which then gets submitted with the rest of the form data.
The last piece was connecting Claude to my Google Sheet so I could just ask it questions in plain language.
My first entry:
Da Vien — Strawberry Cream Oat Latte No ice, 50% sweetness, cream oat milk Notes: 50% sweetness was perfect! Rating: ❤️❤️❤️❤️❤️
Now I can ask Claude "what did I order at Da Vien?" and it reads the sheet and tells me exactly what I got and how I customized it.
I'd spend more time upfront testing the AI parsing prompt with real label photos before building the whole Shortcut around it. The OCR output from real drink labels is messy and the prompt needs to be robust enough to handle all of it.
Absolutely. Not because it's the most efficient system in the world, but because now I'll never forget that Da Vien's Strawberry at 50% sweetness with cream oat milk is a perfect drink.
And honestly? Building it was fun. There's something satisfying about stitching together a bunch of tools that weren't designed to talk to each other and making them work anyway.