Legal Consultant - Fully Remote Job at Mercor, New York, NY

RlluNDNQbmt5VzkzT0VwMFZ3d0tId0k1d3c9PQ==
  • Mercor
  • New York, NY

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: AI Model Evaluation Specialist

Type: Contract

Compensation: $50–$75/hour

Commitment: ~20 hours/week

Role Responsibilities

  • Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
  • Score and rank multiple model responses using structured rubrics across dimensions.
  • Provide written justifications with specific evidence for each evaluation.

Qualifications

Must-Have

  • Master’s degree or higher in Legal or a relevant professional field.
  • Professional experience applying domain expertise in a practitioner or advisory capacity.
  • Familiarity with industry-specific standards, regulations, or clinical guidelines.
  • Strong written communication and critical reasoning skills.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume to begin.
  • Complete the Model Response Evaluation assessment.

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Remote job, Contract work, Summer work

Similar Jobs

Retina Consultants San Diego

Billing Specialist Job at Retina Consultants San Diego

 ...Billing Specialist Position: Billing Specialist Department: Revenue Cycle Location: Poway, CA (Hybrid) Hybrid following successful...  ...experience preferred Benefits ~ Medical, dental, vision ~401(k) with match ~ PTO ~ Employee assistance program... 

BayCoast Bank

IT Help Desk Technician Job at BayCoast Bank

 ...# Advises user(s) on appropriate action. # Has the ability to work well in a team environment. # Follows standard Help Desk procedures. # Actively works within the Help Desk software. # Monitors IT email filter in accordance with the IT Helpdesk... 

Special Strong North Orange County

Adaptive Fitness Trainer Job at Special Strong North Orange County

 ...Benefits: 401(k) Bonus based on performance About the Role: Join Special Strong North Orange County as an Adaptive Fitness Trainer, where you will empower individuals with diverse abilities to achieve their fitness goals. Be a part of a supportive team in Anaheim... 

West Pro Plumbing Inc

Commercial Service and Repair Plumber Job at West Pro Plumbing Inc

 ...Job Description Job Description We are seeking a Commercial Service And Repair Plumber to join our team! The selected individual will install and repair water supply lines and drainage systems. Responsibilities: Assemble and install plumbing systems Troubleshoot... 

Express Employment Professionals - Baton Rouge

Maintenance Manager Job at Express Employment Professionals - Baton Rouge

 ...Maintenance Manager - Baton Rouge $35/hr. Full-Time **Monday-Friday 7 am - 4 pm. Shift Varies, and overtime when needed.** The Maintenance Manager is responsible for leading and managing all maintenance operations. This role oversees technician teams, ensures...