Mid levelPart-timeRemoteQueensland, AustraliaSoftware engineeringQuality engineeringPosted 5 hours ago
About the job
This job offers a unique opportunity to connect with leading tech companies through project-based AI work. Contributors will play a crucial role in evaluating AI coding agents by creating realistic tasks and testing their capabilities. The team values collaboration and innovation, allowing individuals to work flexibly while contributing to exciting AI advancements.
You'll be responsible for
📝
Creating tasks
Developing challenging tasks and evaluation criteria within realistic simulated environments.🔍
Reviewing code
Analyzing code written by AI agents to understand their successes and failures.🤖
Iterating with AI agents
Collaborating with AI to verify tests and ensure they are effective in catching real problems.Key criteria
💻
Degree in Computer Science or related field
Possession of a relevant degree to ensure foundational knowledge.View
🛠️
5+ years software development experience
Demonstrated experience primarily in Python and related technologies.View
🌐
Full-stack development background
Experience building React-based interfaces and robust back-end systems.View
View more