Devin Huber
Résumé

AI automation engineer — Columbus, OH

I build AI automations that run on their own.

Five are in use at my employer today.

See the builds Email me

Open to AI automation & AI engineering roles · relocation or remote

Fig. 1 — How I build AI to run alonehover 1–5
A request goes to the model, which proposes. Code decides whether it acts alone or waits for a person. My evaluation harness scores every outcome against an answer key written in advance, predicts the real error rate, and tunes the prompt and the limits. Eval harnessmy open-source CLI Requestemail, form, file Modelsorts and drafts 1 Code gatechecks every limit Acts alone 2 Person approves 3 scoredscored 4 Measures scores every outcome against an answer key written in advance and reports the silent error rate 5 Predicts a range for the real error rate, noise across repeated runs, and what-if limits before release tunes the prompt tunes the limits

Every build follows this plan. Hover, tap or tab to a part to read what it does.

How the harness works

Results so far

Each number opens its build
5AI agents in use at my employerAll builds 98%of wrong values caught before they went outFinance platform, 87 sealed SEC filings 3×fewer wrong tags after my fixNews-tagging agent, 500-article stress test 0 of 33trick questions fooled my archive AIPodcast archive assistant, one test run

More than 150 figures on this site are re-checked by code every time it changes.

Featured work

All builds
Python · FastAPI · ReactFinance Operations PlatformSpreads statements, reconciles bank against ledger and matches invoices, then sends a person only what it is unsure of. Five engines, one set of controls.0.9%silent error rate, 87 sealed SEC filingsRead the build n8n · in production at my employerExecutive Email AssistantTriages the CEO’s email and drafts replies. Code decides what it may send or book alone, and she sets how far that goes; everything else waits for one evening to-do.20+tested batches of changes in its first 9 daysRead the build Python · in use at my employerPodcast Archive AssistantColleagues ask ten years of interviews a question in their own Claude. Every quote is checked against its transcript in code.2.6Mspoken words it answers from, every quote checkedRead the build

Free tools Error-rate calculator ↗ Workflow cost calculator ↗ Ready-to-ship checklist ↗ n8n export scrubber ↗

Contact

Want to see one run?

I'll screen-share any build: the workflow, the test set and the results, including what didn't work.

Open to AI automation & AI engineering roles · Columbus, OH · relocation or remote

d.huber.professional@gmail.com LinkedIn ↗ GitHub ↗