JuniorMid levelSeniorContract$100 - $210/hour15 - 20 hours/weekRemoteDataInformation technologySoftware engineeringPosted 2 months ago
Pay for this job is USD $70-$150 per hour, which is approx AUD $100-$210. It will be subject to exchange rates.About the job
Mercor is on the lookout for excellent contributors and maintainers to join their exciting journey in open-source projects. This job offers a fantastic opportunity to work with well-known Python repositories, benchmarking coding agents and evaluating their performance. The team values collaboration and flexibility, allowing contributors to work remotely and on their own schedule.
You'll be responsible for
⚙️
Benchmarking performance
Working with clients to benchmark the performance of various coding agents across open-ended software engineering tasks in well-documented Python repositories.🔍
Evaluating coding agents
Evaluating the performance of the coding agent across predefined criteria.💻
Collaborating remotely
Engaging in a fully remote role that allows for flexible scheduling and collaboration with leading AI labs and enterprises.Key criteria
🐍
Python programming experience
Demonstrated experience working with Python source repositories.View
📊
Performance evaluation skills
Proven ability to benchmark and assess coding agent performance.View
🕒
Flexible time commitment
Experience managing 15-20 hours per week with adaptability for extensions.View
View more