We're running a paid study on how expert operational decision-making can be quantified and structured for artificial intelligence systems. The goal is to better understand how complex human judgments are translated into clear criteria and scoring rubrics. This work directly supports the ongoing improvement of advanced data models.
You will participate in a remote session to review various operational scenarios and workflows. During the process, you will be asked to define structured tasks and establish clear evaluation criteria based on your professional experience. We will have you build scoring rubrics that capture the nuances of high-level strategic operations. The session involves focused, independent work alongside guided prompts to capture your logic step by step.
We welcome operations managers, strategic project leaders, and human-data professionals with deep experience in complex decision-making. You should be highly comfortable taking ambiguous business processes and breaking them down into measurable frameworks. Professionals who regularly design operational metrics or evaluation standards will be an especially strong fit.
Review complex operational workflows and strategic business scenarios
Translate high-level judgments into structured tasks and clear evaluation criteria
Design scoring rubrics that accurately measure performance or quality
Explain the reasoning behind your chosen metrics and operational frameworks
Professional background in strategic projects, operations, or human-data workflows
Experience designing evaluation criteria, rubrics, or operational metrics
Comfortable breaking down complex, ambiguous workflows into structured steps
Strong ability to articulate the logic behind operational decisions
$40 per hour
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at terac.com or on YouTube at @jointerac
Terac is building the infrastructure layer that connects AI systems with on-demand human expertise.
We believe the future of work is shifting: instead of humans using AI to do most tasks, AI will increasingly do most work with the help of humans. In that world, companies won’t need traditional employees - but they will still need people. Terac powers that future by making high-quality human labor accessible through a single API.
Today, Terac operates as an expert network for frontier research. We handle sourcing, verification, screening, and payouts so partners can instantly access specialized talent for research, evaluation, and data generation. Our platform enables companies to tap into niche expertise on demand while focusing on building their core products.
Backed by $9M from Emergence, SignalFire, Audacious, and Z Fellows, we’re scaling from research tooling into a broader marketplace for the human data economy - building systems for expert matching, pricing, routing, and trust that will define how AI and humans collaborate at scale.
