Data Annotator - Video Evaluation (Remote, Flexible, Worldwide)
Careerflow.ai · 78 days ago
ABOUT THE ROLE
A US based AI company that is at the forefront of AI research is looking for a detail-oriented and analytically consistent Annotator to evaluate visual and creative content using structured rating frameworks and detailed guidelines.
In this role, you will assess AI-generated and real-world media (images and videos) for quality, realism, composition, and adherence to defined evaluation standards. Your work will directly contribute to improving cutting-edge AI systems.
This position requires strong visual judgment, structured reasoning, and consistency across high-volume evaluation tasks.
WHAT YOU WILL DO
-
Evaluate visual and media content using structured guidelines and predefined rating frameworks.
-
Provide clear, well-structured written justifications to support evaluation decisions.
-
Ensure consistency, accuracy, and attention to detail across high-volume annotation tasks.
-
Identify quality gaps related to realism, composition, motion, lighting, and overall production standards.
JOB REQUIREMENTS
-
3+ years of professional work experience
-
Media/agency experience is mandatory
-
Hands-on experience working directly with designers, photographers, or videographers (mandatory)
-
Experience with AI image or video generation tools is a strong plus
-
Strong understanding of motion realism, lighting, camera movement, composition, and production quality
-
Strong analytical, logical reasoning, and research skills and excellent communication and collaboration abilities, with proficiency in English.
-
Incorporate feedback from LLM performance metrics into training data creation.
-
Ability to commit to 40 hours per week and candidates who can join immediately preferred.
REQUIRED QUALIFICATIONS
Bachelor’s degree or higher in:
-
Design, Visual Communication, or Fine Arts
-
Film, Media, Animation, or VFX
-
Photography or Cinematography
-
Architecture or Industrial Design
-
Creative Writing or equivalent professional experience in content creation, media production, or content review.
APPLICATION PROCESS
-
Submit your resume, profile, and questionnaire here on this job description
-
If you are selected, you will receive an Interest Confirmation Form (ICF)
-
An Assessment will be shared after 2-3 days of application.
-
If you pass the assessment, you can start immediately
PAY, COMPENSATION, AND FURTHER DETAILS
-
Pay: $2.5 to $5 per hour depending on experience (Approximately Rs. 40,000 per month for 40 hours per week)
-
Assignment Type: Independent Contract
-
Total Number of Positions: 350
-
Start Date: May 28th, 2026
-
Commitment Required: 40 hours per week (6 hours overlap with PST)
-
Years of Experience: 3 Years of Experience required
-
Engagement Length: 4 weeks