Position: AI Evaluation Specialist Type: Contract Compensation: $22 - $70/hour Location: Remote Commitment: 10-40 hrs/week Role Responsibilities

• Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
• Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
• Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.

Requirements

• Have native English proficiency at C1 or C2 level.
• Possess exceptional reading comprehension and acute attention to detail.
• Demonstrate strong observational skills with excellent aesthetic or editorial judgment.
• Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
• Have excellent written and verbal communication skills.

Application Process

• Easy Apply on LinkedIn
• Check email for next steps
• Participate in resume evaluation & interview stage

Apply To This Job