Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.

About the role

Lead the end-to-end delivery of large-scale multimodal AI annotation projects while managing clients, teams, quality, timelines, and budgets. The role requires making quick, data-driven decisions in a fast-paced environment with tight, often 24-hour, delivery timelines.

Key Responsibilities

• Manage project scope, resources, timelines, budgets, and delivery.

• Act as the primary client contact and manage stakeholder communication.

• Lead and mentor Team Leads.

• Partner with Quality Managers to maintain quality standards.

• Monitor throughput, accuracy, and turnaround time.

• Identify risks and take corrective action promptly.

• Scale teams and improve processes based on project requirements.

Required Qualifications

• 7+ years of experience, including 4+ years in team leadership.

• Experience managing complex, high-volume projects.

• Strong client communication and stakeholder management skills.

• Data-driven decision-making and familiarity with performance metrics.

• Experience in annotation, data labeling, AI training, RLHF, SFT, or model evaluation is preferred.

Offer Details:

1. This is a project-based role involving a defined number of evaluation tasks.

2. Each task will involve comparing multiple chatbots and providing a final assessment.

3. Work Schedule: Five working days per week, including weekends as required, with two weekdays off.

4. Work Hours - 7am-4pm PST

5. Duration: 16 weeks.