All roles

Open role

LLM Evaluator – Reasoning Analysis, Accuracy & Content Quality | Remote

Remote · Brazil Full-time

Position: Generalist Expert Type: Hourly contract Compensation: $60 $200/hour Location: Remote Commitment: Part-time or full-time, flexible based on project needs Role Responsibilities

  • Evaluate AI-generated responses for accuracy, reasoning, and clarity
  • Provide structured, detailed written feedback on model outputs
  • Identify gaps in logic, implicit assumptions, and reasoning flaws
  • Apply evaluation guidelines consistently across tasks
  • Write clear, evidence-based rationales beyond surface-level observations
  • Ensure high-quality, unbiased, and precise assessments

Requirements

  • Bachelor s degree preferred from a top-ranked university
  • Strong analytical thinking and critical reading skills
  • Strong written communication with clear and precise reasoning
  • Ability to identify nuanced issues in complex responses
  • Strong attention to detail and consistency in evaluations
  • Ability to work independently and follow structured guidelines
  • Native-level English proficiency
  • Ability to complete tasks without using AI writing tools

Application Process (Takes 20 Mins)

  • Upload your resume.
  • Complete an interview.
  • Submit a short form.

More open positions

Product Owner - Group Health - REMOTE

Work from home Full-time role

Product Owner / Product Manager Contract Lifecycle Management (CLM) -US - Remote - PST Time Zone

Work from home Full-time role

[Remote] Task Lead/ Project Manager

Work from home Full-time role

Project Manager 4

Work from home Full-time role

Clinical Project Manager II – Inflammation/ Phase 2b (Sponsor Dedicated/ Remote; Hybrid Foster City, CA Preferred)

Work from home Full-time role

Biostatistician – Remote

Work from home Full-time role

Data Entry - Typist Part-Time - Work

Work from home Full-time role

Outside Sales Representative- 100k to 195k+ | Real Estate Acquisitions

Work from home Full-time role

Receptionist/Verification Specialist

Work from home Full-time role

[Remote] Hair & Beauty Content Writer

Work from home Full-time role

Life Underwriter

Work from home Full-time role

Power BI Reporting Developer (Remote)

Work from home Full-time role

Arizona Remote Licensed Mental HealthTherapist, 1099 Contractor

Work from home Full-time role

SOC Analyst - Endpoint Detection & Response

Work from home Full-time role

[Remote] Senior Account Executive

Work from home Full-time role

[Remote] Lead Employee Relations Partner

Work from home Full-time role

Commissioning Project Engineer

Work from home Full-time role

Fundraising Coach

Work from home Full-time role

[SSD] Python Developer

Work from home Full-time role

Director, Growth Strategy & Analytics, Go-to-Market

Work from home Full-time role

WFH Customer Service Representative (Entry Level)

Work from home Full-time role