Human-data programs for frontier model work. Pilot to delivery, with calibration and QC.

  • Supported frontier AI labs through external AI data partners, from training data and review to program management.
  • Defined standards, calibration materials, and quality controls for programs involving 3,000+ contributors.
  • Ran client pilots from design through implementation and delivery.

What you get.

One workflow at a time. Each step ends with something your team can use and a number you can check.

Find and test

We pick a workflow your team repeats every week. I collect real examples, write down what a correct result looks like, and test AI against them.

You get a short report with the error rate, the cases it gets wrong, and a clear call on whether it's worth building.

Build and pilot

I build the workflow with your team, on the tools you already have, or on a simpler setup that replaces a paid tool when that costs less. It runs on real work while we compare time and accuracy against the bar from step one.

You get a working workflow, written instructions, and pilot results.

Train and keep it right

I train your staff to use it and to review what it produces, with a checklist, spot checks, and clear rules for what goes to a person. Then I check the results on a schedule, so quality doesn't drop.

You get trained staff, a review routine they own, and regular quality check-ins.

A good fit for teams that handle a lot of documents, email, forms, or reviews, and need the results to be right.

Why me

  • Quality at scale. I defined standards, calibration materials, and quality controls for programs involving 3,000+ contributors.
  • Pilots through delivery. I ran client pilots from design through implementation and delivery.
  • Training people. 15 years of STEM teaching and program building. As a Code.org facilitator, I trained 100+ professionals to adopt programming and computer-science tools.
  • A published method. AutoQA, my framework for deciding when automated review can and can't support a QA decision.

Describe one task your team repeats every week. I'll reply with whether AI can do it well and how I'd test it.

Open to contract and full-time remote.

Roles in AI program management, human data operations, training and quality, and AI data delivery.

Or email owen.onderdonk@gmail.com for my resume.

What I do.

Program management for human data and AI evaluation, built on hands-on review and evaluation work.

Program and delivery

  • Task specs, contributor requirements, review workflows, and acceptance criteria, built from research goals and failure modes
  • Client pilots from design through implementation and delivery
  • Day-to-day contributor ops and delivery coordination
  • Client collaboration and contributor communications

Contributors and quality

  • Standards, calibration materials, and quality controls for large contributor programs
  • Training, live office hours, and calibration sessions that close quality gaps before delivery
  • Reviewer oversight, including review of the reviewers
  • Catching calibration drift and the failures automated checks miss

Hands-on evaluation

  • Complex mathematics and physics training data, with worked solutions that serve as reference answers
  • Rubrics, reference solutions, and structured critiques
  • Review of AI answers and code for correctness, assumptions, units, limits, and edge cases
  • Practical Python and coding agents for evaluation and validation, with human review

AutoQA

When reviewers of AI training data disagree, what can an automated check settle, and what has to stay with a person?

A framework I designed and published. It checks each claim in a review against the written instructions and the evidence the reviewer had, and returns one of four results. Unclear instructions go to the person who owns them and don't count against the contributor.

A system design, a synthetic demonstration, and a research base of sourced claims. Nothing here estimates accuracy on real work.

Read AutoQA
  • SupportedThe evidence backs the claim.
  • ContradictedThe evidence shows the claim is wrong.
  • Insufficient evidenceThe record isn't enough. That isn't proof of error.
  • Instructions don't decideIt goes to the person who owns the instructions.

From physics and teaching to AI data.

AI data and evaluation

Since 2024

Entered frontier-model data work in February 2024 creating complex mathematics and physics training data. Advanced to contributor review and reviewer oversight, and in February 2025 expanded into project development, client collaboration, program management, quality leadership, and broader operations. Project details are confidential.

STEM teaching and program building

15 years

Built an engineering and advanced-manufacturing program spanning multiple schools. Coordinated the School Board, superintendent, administrators, and community stakeholders to define, support, and launch it. Increased STEM participation by 33% and helped students earn 200+ professional certifications. Trained 100+ professionals to adopt programming and computer-science tools as a Code.org facilitator.

Education

NC State and Randolph College

Bachelor's in Physics (NC State), with experimental nuclear-physics research involving ultracold neutrons. Master's in Curriculum and Instruction (Randolph College).

Email me.

✦ Learning Voyage LLC. Independent practice.