All roles

Open role

Copy of AI Code Reviewer & Systems Evaluation Engineer 2

Remote · New Zealand Full-time

Company Description

An enterprise client is currently seeking experienced software engineers to contribute to improving advanced AI systems through human feedback. This work supports leading AI organizations in training large language models to better understand software development practices, debugging, and code quality. This is part of a cutting-edge initiative focused on enhancing how AI systems write, review, and optimize code in real-world scenarios. You’ll play a key role in shaping how AI models evaluate performance, detect issues, and generate reliable outputs.

Job Description

This opportunity is ideal for engineers who enjoy analyzing systems, improving code quality, and working on complex technical challenges. You will contribute to AI training projects by evaluating outputs, refining logic, and identifying potential vulnerabilities. What You'll Do: Develop objective, verifiable evaluation criteria (rubrics) for system performance Review system logs and execution paths to improve reliability and code quality Refactor code and optimize system behavior toward ideal outcomes Test systems for vulnerabilities, including data exposure and edge-case failures Provide detailed, high-quality feedback on system performance and outputs

Qualifications

Requirements: 2+ years of experience in backend engineering, AI automation, or systems integration Strong proficiency in at least two programming languages (e.g., Python, JavaScript, Go, Java) Experience working with SQL databases Proven ability to build and maintain production-grade systems Experience working in live (non-mocked) environments with multi-step interactions Strong analytical skills and attention to detail Nice to Haves: Experience with multi-stage system workflows and coordination tasks Familiarity with integrating tools such as APIs, databases, or external platforms Understanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation) Experience working with AI systems or agent-based workflows Comfort working with persistent state tracking or similar frameworks Additional Information Fully remote and flexible work schedule Project-based engagement with no guaranteed hours Work on tasks based on availability and project assignment Payment is based on completed tasks only Must accept project invitations before beginning work Freelancers may accept or decline tasks depending on availability No guaranteed workload; volume may vary weekly

More open positions

Copy of AI Code Reviewer & Systems Evaluation Engineer 2

Work from home Full-time role

Copy of AI Code Reviewer & Systems Evaluation Engineer 2

Work from home Full-time role

Senior SAP PSCD Consultant (m/f/d)

Work from home Full-time role

Copy of AI Code Reviewer & Systems Evaluation Engineer 2

Work from home Full-time role

SAP S/4 Principal Developer (m/f/d)

Work from home Full-time role

Working Student AI Balancing / Machine Learning Engineer

Work from home Full-time role

[Remote] Senior Software Engineer, Data Platform

Work from home Full-time role

Experienced Customer Support Agent – Artist Support Associate

Work from home Full-time role

Community Organizer - Early Childhood Education

Work from home Full-time role

French Bilingual Customer Service Representative

Work from home Full-time role

Benefits Analyst

Work from home Full-time role

Data Entry Clerk Work From Home - Part-Time Focus Group Participants (Up To $750/Week)

Work from home Full-time role

Remote Website Chat Support Agent – Entry‑Level Customer Service Role with Flexible Hours, Competitive Pay, and Remote‑First Culture

Work from home Full-time role

Principal CoreValve Therapy Development Specialist (Bay Area & Central Coast)

Work from home Full-time role

Vice President / Deputy General Counsel, Litigation & Intellectual Property (Remote) (914-SLS)

Work from home Full-time role

Remote Live Chat Support Specialist – Customer Experience Champion for careerzynith (Fully Remote, Flexible Hours)

Work from home Full-time role

Remote Escrow Officer / Real Estate Paralegal (TN & VA)

Work from home Full-time role

Physics Expert - AI Trainer (Finland)

Work from home Full-time role

[Remote] Customer Success Manager (eCommerce Live stream Platform)

Work from home Full-time role

Amazon Connect Developer

Work from home Full-time role

[Remote] Account Executive #3 - Boston

Work from home Full-time role