Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Pay for this job is USD $60 to $80 per hour, which is approx AUD $80 to $110. It will be subject to exchange rates.
About the job
This job is an exciting opportunity to participate in a structured evaluation pilot at Mercor, where experts will assess how frontier AI models perform on realistic professional tasks. Your insights will play a crucial role in shaping the understanding of AI capabilities in various business domains. The team values collaboration and professional judgment, and you will work independently while contributing to meaningful research.
You'll be responsible for
📝
Signing an NDA
Signing a Non-Disclosure Agreement before receiving any materials related to the study.🔍
Solving a task
Completing one realistic, domain-specific task using the provided source files.📊
Reviewing model outputs
Evaluating five model-generated outputs, ranking them, scoring each, and providing evidence-based rationales.Key criteria
🧠
Domain expertise
5+ years of hands-on experience in Admin, Marketing, HR, or Accounting.View
✍️
Evidence-based rationale writing
Proven ability to write clear, specific rationales for judgments.View
⏳
Reliability under tight deadlines
Demonstrated reliability in delivering quality work within short timeframes.View
