Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.

About the role

Lead annotators in producing accurate, high-quality AI training data. You will manage daily operations, coach team members, monitor productivity and quality, and ensure timely delivery in a fast-paced environment with tight, often 24-hour, turnaround times.

Key Responsibilities

• Manage annotation batches from launch through delivery.

• Review client guidelines and convert them into clear team instructions.

• Lead annotators and Pod Leads, set daily targets, and maintain staffing.

• Monitor productivity and quality metrics.

• Conduct coaching, retraining, and remediation when required.

• Collaborate with QA and tooling teams to improve processes.

• Develop high-performing team members for future leadership roles.

• Report project progress, risks, and blockers to the Project Lead.

Required Qualifications

• 4–6 years of overall experience, including 2+ years of team leadership.

• Experience managing teams against productivity and quality targets.

• Strong communication, organizational, and problem-solving skills.

• Ability to simplify complex guidelines and manage competing priorities.

• Experience in annotation, data labeling, or AI training data projects is preferred.

Offer Details:

1. This is a project-based role involving a defined number of evaluation tasks.

2. Each task will involve comparing multiple chatbots and providing a final assessment.

3. Work Schedule: Five working days per week, including weekends as required, with two weekdays off.

4. Work Hours - 7am-4pm PST

5. Duration: 16 weeks.