Analytical Evaluator - AI Feedback

Mercor connects elite creative and technical talent with leading AI research labs. The company is based in San Francisco and has notable investors including Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Location: Remote

Salary: $70/hour

Responsibilities

• Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
• Provide structured written feedback to improve AI model outputs.
• Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content.
• Write clear, precise, and well-evidenced rationales beyond surface-level observations.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Requirements

• Bachelor's degree from a top-500 globally ranked university preferred.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.
• Strong critical reading skills.
• Native English fluency.

Additional Information

• Application process takes 20–30 mins to complete: upload resume, AI interview based on resume, submit form.
• Resources & Support: For details about the interview process and platform, visit https://talent.docs.mercor.com/welcome. For help, contact support@mercor.com.
• The team reviews applications daily. Complete your AI interview and application steps to be considered.