Mid levelSeniorDirectorContract$135 - $165/hourFrom 10 hours/weekRemotePosted 6 days agoVerified 6 days ago
Pay for this job is USD $100-$120 per hour, which is approx. AUD $135-$165. It will be subject to exchange rates.
About the job
This job at Mercor involves partnering with a leading legal AI company to benchmark AI systems in answering questions of Australian law. As an expert reviewer, you will play a crucial role in evaluating AI responses, ensuring they meet high standards. The team values collaboration and independence, allowing you to work remotely and on your own schedule.
You'll be responsible for
🤖
Running prompts across AI platforms
Running the same set of prompts across two AI (LLM) platforms to benchmark their responses.📊
Comparing outputs
Comparing the outputs from both platforms side by side to evaluate their effectiveness.✍️
Submitting feedback
Submitting concise written feedback for every evaluation based on the standardized rubric provided.Key criteria
⚖️
In-house legal counsel experience
5+ years as in-house legal counsel practising in Australia.View
📜
Knowledge of Australian law
Strong command of commercial and contract law matters.View
✍️
Attention to detail
Proven ability to provide precise written feedback.View