Architected an automated LLM benchmarking and evaluation scoreboard with AI researchers in Claude Code, saving ~30 hours of engineering and evaluation time per week.
SubquadraticI build AI products, from research to revenue
For the last 4 years, I’ve been building platform, API, and AI products across consumer, enterprise, and developer markets: from speech and LLM products at a frontier AI lab to no-code computer vision on the factory floor.
AI that works outside the demo.
Evaluation, data quality, testing, and adoption: the unglamorous work that gets AI products to real users and real revenue.
A custom automated LLM benchmarking and evaluation scoreboard, architected with AI researchers and built in Claude Code.
SubquadraticNear-zero hallucination rate, measured against a 2,000+ question golden evaluation bank, through HITL validation.
Re:Course AIFound and fixed metadata and transcription defects in golden datasets.
SubquadraticEstimated, from an automated behavior-driven testing suite for the TTS API.
Subquadratic30-day retention lift across 129 PMs, coaching AI-native product-led growth.
AdobeComputer vision for non-technical manufacturing and security teams, opening up a ~$3B market.
Groundlight AIA Vanderbilt University pilot turned annual contract, with pharma contracts worth $750K ARR in the pipeline.
Re:Course AIThe AI toolkit
LLM benchmarking (NIAH, RULER, SWE-bench Verified) · LLM-as-judge · HITL validation · golden datasets · bias evaluation
Model fine-tuning · conversational GenAI · speech AI (TTS, STT, ASR) · computer vision
Claude Code · Cursor · Python · SQL · JavaScript · AWS · Google Cloud · Kubernetes · Vercel · Cloudflare
AI problems I’ve already solved
If one of these sounds familiar, let’s talk.
Designed and ran HITL validation across multiple fine-tuning cycles, personally reviewing model outputs, to reach a near-zero hallucination rate on a 2,000+ question golden evaluation bank and MLR approval in two months.
Re:Course AITurned engineer-centric computer vision tooling into a no-code onboarding interface for non-technical users in three months, across 10 engineers and 4 ML scientists.
Groundlight AIRecovered ~100k hours of training data by identifying and fixing metadata and transcription defects in golden datasets.
SubquadraticWrote an automated behavior-driven testing suite for a TTS API, cutting debugging time by an estimated 75%.
SubquadraticLifted 30-day adoption of an internal GenAI productivity tool by 33% across 129 PMs by coaching AI-native product-led growth workflows.
AdobeLet’s build something.
Next, I’m looking for a long-term home: a team scaling a product people already pay for.
Hiring a product leader?
I’d love to hear about the role and the team. Send it my way and let’s talk.
Want to talk shop?
Product, learning science, or building things with Claude Code. Happy to compare notes.