Language Specialist - Fully Remote | Up To $20/Hr Part-Time

Mercor connects elite creative and technical talent with leading AI research labs. The company is based in San Francisco and has notable investors including Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Location: Remote

Salary: $15–$20/hour

Responsibilities

• Conduct fact-checking using trusted public sources and external tools.
• Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
• Assess reasoning quality, clarity, tone, and completeness of responses.
• Ensure model responses align with expected conversational behavior and system guidelines.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Requirements

• Bachelor's degree.
• Native speaker in Telugu.
• Significant experience using large language models.
• Excellent writing skills in English.
• Strong attention to detail.
• Background or experience in domains requiring structured analytical thinking.

Additional Information

• Prior experience with RLHF, model evaluation, or data annotation work is preferred.
• Experience writing or editing high-quality written content is preferred.
• Experience comparing multiple outputs and making fine-grained qualitative judgments is preferred.
• Application process takes 20–30 mins: upload resume, AI interview, submit form.
• Resources and support available at https://talent.docs.mercor.com/welcome and support@mercor.com.
• Applications are reviewed daily; complete your application to be considered.