Mid levelSeniorDirectorContract$135 - $165/hourFrom 10 hours/weekRemotePosted 3 days agoVerified 3 days ago
Pay for this job is USD $100-$120 per hour, which is approx. AUD $135-$165. It will be subject to exchange rates.About the job
Mercor is excited to partner with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law. As an expert reviewer, you will play a crucial role in evaluating AI responses, providing valuable insights that can shape the future of legal technology. The team values collaboration, independence, and a commitment to excellence in every evaluation.
You'll be responsible for
🤖
Running prompts
Running the same set of prompts across two AI (LLM) platforms.🔍
Comparing outputs
Comparing the outputs from both platforms side by side.📊
Scoring responses
Scoring each response against a standardized rubric provided by the company.Key criteria
⚖️
Litigation and disputes experience
2+ years in litigation or disputes at a law firm or chambers.View
📜
Qualified to practice in Australia
Possession of a valid Australian legal practicing certificate.View
✍️
Strong written communication
Demonstrated ability to provide concise, precise written feedback.View
