About the job
This job offers an exciting opportunity to work on project-based AI tasks that evaluate coding agents for leading tech companies. Contributors will play a crucial role in building datasets and creating realistic developer tasks, all while collaborating with AI. The team values flexibility and encourages contributors to choose their working hours, making it a perfect fit for experienced developers and software engineers looking for part-time, non-permanent projects.
You'll be responsible for
📝
Creating tasks
Designing challenging tasks and evaluation criteria within realistic simulated environments.🤖
Iterating with AI agents
Collaborating with AI agents to verify tests and ensure they catch real problems.🔍
Reviewing code
Analyzing code written by agents and designing edge cases and adversarial scenarios.Key criteria
💻
Degree in Computer Science or related field
Possession of a relevant degree is essential for understanding complex concepts.View
🐍
5+ years software development experience
Demonstrated experience primarily in Python, including frameworks like FastAPI.View
🌐
Full-stack development background
Experience building React-based interfaces and robust back-end systems.View
View more