Quality Assurance Specialist Job at Mercor, San Francisco, CA

K3hrTHpVS1kyejR5UEZYbldkc3o3TVJUd1E9PQ==
  • Mercor
  • San Francisco, CA

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Quality Control Lead

Type: W2 Employment

Compensation: $80$105/hour

Location: Remote

Commitment: 40 hours/week

Role Responsibilities

  • Audit and evaluate detailed personas digital environments and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.
  • Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agents ability to reason filter and prioritize.
  • Identify logical inconsistencies factual errors missing context and technical flaws such as invalid JSON structures.
  • Provide clear constructive and actionable feedback to scenario designers to refine their worlds and improve output.
  • Document outcomes by logging review results scores and feedback in Airtable and Crucible .

Qualifications

Must-Have

  • Undergrad degree
  • 2 years professional experience

Preferred

  • Editing / QA background Senior editor QA tester technical reviewer compliance auditor or peer-reviewer.
  • Technical / data comfort JSON familiarity Jira/Asana power user data analyst SQL/Python exposure.
  • Process & Systems thinking Operations managers technical PMs or systems designers.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Full time, Summer work

Similar Jobs

Rampart Aviation LLC

A&P Technician Job at Rampart Aviation LLC

 ...maintenance, repair, modifications, and inspections. Minimum of four years total aviation maintenance experience, plus a civilian or military aviation maintenance technical school is preferred. REQUIRED QUALIFICATIONS: Candidates must hold a Federal Aviation Administration... 

Access Physical Therapy & Wellness

Patient Coordinator (Medical Receptionist) Job at Access Physical Therapy & Wellness

 ...accurate patient records by registering new patients, updating information in the Electronic Medical Records (EMR) system, and preparing necessary documents Answer phone calls, assist patients, and uphold HIPAA compliance, ensuring a welcoming and professional healthcare... 

Child & Family Focus, Inc.

Bachelors Level Mental Health Intern Job at Child & Family Focus, Inc.

 ...Child and Family Focus Internship Are youlooking to explore a career in the public health field? Child and Family Focus may be the right fit for you! Internship Overview: Child and Family Focus is looking for interns for 2026/2027! We provide a robust internship... 

Russ' Restaurant

Restaurant Host Job at Russ' Restaurant

 ...Restaurant Host at Russ' Restaurant Are you a highly skilled and motivated individual with a passion for creating a warm and welcoming atmosphere? Do you love treating everyone you meet like an old friend? If so, we have an immediate opening for a Restaurant Host at... 

MalaceHR

Water Treatment Plant Operator Job at MalaceHR

 ...Job Title: Water Treatment Plant Operator Location: New Jersey Pay: $38.00 $42.25 per hour Schedule: Monday Friday | 7:00 AM 3:30 PM Parking: Free onsite Interviews: 1st Round Virtual | 2nd Round In-Person Position Overview We are...