QA Auditor (Sampling, Quality Gates, Release Readiness) - USA JD: QA Auditor — Surgical Video Annotation (Sampling, Quality Gates, Release Readiness) Location: USA | Type: Full-time Reports to: Quality Lead / Program Lead Role goal: Protect dataset quality at scale by running sampling-based audits, enforcing quality gates, and ensuring every dataset release is audit-ready and meets acceptance thresholds. Responsibilities Execute sampling plans (stratified by label type, difficulty, site/surgeon/device, model confidence) for ongoing QA and release audits.Audit annotations against guidelines + ontology; score defects using standardized rubrics (severity, type, root cause).
Run and validate quality gates prior to release: completeness/coverage checksschema/constraint checks (illegal combinations, temporal consistency, boundary rules)defect density and rework thresholdsGenerate rework tickets with precise instructions; track closure and verify fixes.Partner with Annotation Lead to drive calibration actions (training refreshers, guideline clarifications, examples library).Maintain QA dashboards: defect rate, rework %, gate pass rate, audit cycle time, top error patterns by annotator/team/label type.Support release readiness: ensure required artifacts are complete for the Evidence Pack (QA results, sampling logs, sign-offs).Escalate systematic issues to Adjudication/Clinical Review (definition gaps, ambiguous classes, recurring edge cases).Deliverables (what you produce weekly)QA audit reports (sample size, findings, severity distribution, root-cause categories)Gate status + release checklist sign-off recommendationsRework queue and closure verificationTrend insights and corrective action plan (top 3 issues + fixes)
Requirements 3–7+ years in data QA / annotation QA / operations quality; experience auditing labeled datasets (video preferred).Strong command of sampling-based QA: stratified sampling, acceptance thresholds, and audit scoring.High attention to detail; comfortable reading and enforcing detailed SOPs/guidelines.Strong documentation skills; can write clear defect descriptions and rework instructions.Comfortable with dashboards/spreadsheets; basic metric literacy (defect density, rework, throughput).
Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.
At Codvo.ai, we specialize in leveraging artificial intelligence, cloud, and data to solve complex business problems and drive innovation. Our passion for innovation drives us to deliver solutions that not only meet but exceed your unique business needs, fostering smarter, more productive teams. Here’s why our approach has earned widespread acclaim from our clients:
67 Customer NPS: Our Net Promoter Score is a testament to the high level of satisfaction and loyalty among our clients. It underscores our ability to deliver quality and value through our specialized services, making us a preferred partner for businesses looking to leverage AI and data for competitive advantage.
78 Employee NPS: The satisfaction and engagement of our team directly influence the quality of service we provide. Our high employee NPS signifies a motivated, dedicated team that's committed to excellence. This positive work culture ensures that we can deliver exceptional AI-first engineering and enterprise data application services to you.
Our approach goes beyond traditional software development; we're dedicated to partnering with you to harness the power of AI and data. The combination of our high trial and engagement success rates, extensive experience, and positive feedback from both clients and employees positions us as more than just a service provider. We're your trusted ally in navigating the complexities of today's digital landscape, committed to transforming your vision into a reality with cutting-edge AI and data solutions.
