MYOB
SeniorFull-timeRemoteSydney NSW, AustraliaDataInformation technologySoftware engineeringPosted 1 month ago
View your fit0 of 9 criteria met
About the job
This job is about being the Design Generation Evaluation owner, where you'll build the infrastructure for quality monitoring across Design Generation. Your expertise in evaluation methodologies will empower teams to effectively assess their systems, ensuring high-quality outputs. Collaboration is key, as you will work closely with various teams to create a seamless evaluation ecosystem.
You'll be responsible for
🔍
Optimizing evaluation systems
Understand and optimize existing evaluation systems including LLM-as-Judge frameworks and visual quality models, analyzing their strengths and limitations.⚙️
Designing automated evaluation pipelines
Design and implement automated evaluation pipelines that score generated designs at scale, balancing accuracy with computational cost.🔗
Integrating evaluation systems
Integrate evaluation systems into continuous deployment pipelines, creating automated quality gates that catch regressions before production.What we're looking for
🔍
Strong ML engineering fundamentals
Experience building and maintaining production ML systems at scale.View fit
⚙️
Robust infrastructure development
Proven ability to build scalable infrastructure, not just models.View fit
📊
SQL fluency
Ability to query and analyze large datasets effectively.View fit
View more
