About the job
This job offers an exciting opportunity to connect with leading tech companies while working on project-based AI initiatives. Contributors will play a crucial role in evaluating AI coding agents by creating realistic tasks and environments. The team values collaboration and innovation, allowing individuals to choose their work hours while meeting project deadlines.
You'll be responsible for
📝
Creating tasks
Developing challenging tasks and evaluation criteria within realistic simulated environments.🏗️
Designing isolated environments
Setting up emulations of a developer's workstation with necessary tools and codebases.🔍
Reviewing code
Analyzing code written by AI agents and designing edge cases for testing.Key criteria
💻
Degree in Computer Science or related field
Possession of a relevant degree is essential for understanding complex concepts.View
🖥️
5+ years software development experience
Demonstrated experience primarily in Python and related technologies.View
🔧
Full-stack development background
Experience with React-based interfaces and robust back-end systems.View
View more