Back to remote jobs

(US) QA Auditor (Sampling, Quality Gates, Release Readiness)

Codvo

Quality & Evaluation Full-time
United States June 29, 2026

Job description

<div><strong>QA Auditor (Sampling, Quality Gates, Release Readiness) - USA</strong><strong> &nbsp;</strong></div><div><strong>JD: QA Auditor — Surgical Video Annotation (Sampling, Quality Gates, Release Readiness)&nbsp;</strong></div><div><strong>&nbsp;</strong></div><div><strong>Location: USA | Type: Full-time&nbsp;</strong></div><div><strong>Reports to: Quality Lead / Program Lead&nbsp;</strong></div><div>Role goal: Protect dataset quality at scale by running sampling-based audits, enforcing quality gates, and ensuring every dataset release is audit-ready and meets acceptance thresholds.</div><div><strong>&nbsp;</strong></div><p style="margin-bottom:0cm;"><strong>About Us</strong></p><p style="margin-bottom:0cm;">At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.</p><div><br></div><div><br></div><div><strong>Responsibilities&nbsp;</strong></div><div>Execute sampling plans (stratified by label type, difficulty, site/surgeon/device, model confidence) for ongoing QA and release audits.</div><div>Audit annotations against guidelines + ontology; score defects using standardized rubrics (severity, type, root cause).</div><div><br></div><div><strong>Run and validate quality gates prior to release:&nbsp;</strong></div><div>completeness/coverage checks</div><div>schema/constraint checks (illegal combinations, temporal consistency, boundary rules)</div><div>defect density and rework thresholds</div><div>Generate rework tickets with precise instructions; track closure and verify fixes.</div><div>Partner with Annotation Lead to drive calibration actions (training refreshers, guideline clarifications, examples library).</div><div>Maintain QA dashboards: defect rate, rework %, gate pass rate, audit cycle time, top error patterns by annotator/team/label type.</div><div>Support release readiness: ensure required artifacts are complete for the Evidence Pack (QA results, sampling logs, sign-offs).</div><div>Escalate systematic issues to Adjudication/Clinical Review (definition gaps, ambiguous classes, recurring edge cases).</div><div>Deliverables (what you produce weekly)</div><div>QA audit reports (sample size, findings, severity distribution, root-cause categories)</div><div>Gate status + release checklist sign-off recommendations</div><div>Rework queue and closure verification</div><div>Trend insights and corrective action plan (top 3 issues + fixes)</div><div><br></div><div><br></div><div><strong>Requirements&nbsp;</strong></div><div>3–7+ years in data QA / annotation QA / operations quality; experience auditing labeled datasets (video preferred).</div><div>Strong command of sampling-based QA: stratified sampling, acceptance thresholds, and audit scoring.</div><div>High attention to detail; comfortable reading and enforcing detailed SOPs/guidelines.</div><div>Strong documentation skills; can write clear defect descriptions and rework instructions.</div><div>Comfortable with dashboards/spreadsheets; basic metric literacy (defect density, rework, throughput).</div><div><br></div><div> </div><p style="margin-bottom:0cm;">Note- <span>Please apply via our official careers portal only, as applications sent directly to executives may not be considered.</span>&nbsp;</p>

Apply now

You will be redirected to the company's website to complete your application.

Apply now

Stay in the loop.

One email per week, 5 hand-picked roles.