Job Description

About Centific

Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology platforms to empower the Magnificent Seven and our enterprise clients with safe, scalable AI deployment. Our team includes more than 150 PhDs and data scientists, along with more than 4,000 AI practitioners and engineers. We harness the power of an integrated solution ecosystem—comprising industry-leading partnerships and 1.8 million vertical domain experts in more than 230 markets—to create contextual, multilingual, pre-trained datasets; fine-tuned, industry-specific LLMs; and RAG pipelines supported by vector databases. Our zero-distance innovation™ solutions for GenAI can reduce GenAI costs by up to 80% and bring solutions to market 50% faster.

Our mission is to bridge the gap between AI creators and industry leaders by bringing best practices in GenAI to unicorn innovators and enterprise customers. We aim to help these organizations unlock significant business value by deploying GenAI at scale, helping to ensure they stay at the forefront of technological advancement and maintain a competitive edge in their respective markets.

About Job

This role involves overseeing the quality and consistency of content annotation work performed by the annotator team. The individual will audit annotated content against guidelines, grade annotator output, identify and resolve discrepancies, and drive continuous improvement of annotation standards and rubrics.

• Review and audit annotator output (text, images, video) for accuracy, consistency, and adherence to guidelines
• Grade annotator assignments, projects, and assessments
• Provide timely and accurate evaluation
• Identify discrepancies and provide clear, actionable feedback to annotators
• Conduct calibration checks to ensure fairness and consistency across annotators
• Perform spot-checks and sampling-based quality audits
• Conduct data collections based on client requirements
• Gather information or data from various sources
• Track quality metrics (accuracy, consistency, throughput) and report trends to stakeholders
• Collaborate with annotators and clients to refine grading rubrics and annotation criteria
• Escalate recurring errors or guideline gaps to program leads
• Support onboarding and training of new annotators on standards
• Maintain detailed records for tracking and reporting
• Ensure timely turnaround of quality reviews to meet client SLAs
• Contribute to feedback loops and continuous improvement initiatives

Centific is an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, citizenship status, age, mental or physical disability, medical condition, sex (including pregnancy), gender identity or expression, sexual orientation, marital status, familial status, veteran status, or any other characteristic protected by applicable law. We consider qualified applicants regardless of criminal histories, consistent with legal requirements.