- 9 BATTERY ROAD Central Region (Singapore) Singapore

Lokasi Kerja
Penerangan Kerja
Tanggungjawab
HUD builds the infrastructure for training and evaluating AI agents. Our platform lets teams create reinforcement learning (RL) environments, benchmarks and evaluations, and our marketplace connects data vendors with frontier AI labs.
You will build the quality control (QC) systems that decide whether training data delivered to AI labs meets our standards.
Key responsibilities
Define and enforce quality standards for agent training data
Build auditing systems for supplier datasets, including sampling, rule-based checks, model-assisted validation and feedback loops
Design metrics and experiments to grade agent outputs
Work with data vendors to diagnose quality issues and agent failure modes
Build QC findings into internal tools and the vendor portal
Requirements
Degree in Computer Science, Engineering or a related field, or equivalent practical experience
Solid software or machine learning engineering skills, shown through work, internships, research or projects
Strong Python, Docker and Linux skills
Experience building validation pipelines and automated QA/QC end to end
Experience with benchmarks and evaluations
Good to have
Background in statistics
Experience designing QA processes or new evaluation tasks
Work location: On-site at our Singapore office, 9 Battery Road (Raffles Place). Full-time, permanent. 21 days of annual leave; CPF contributions for eligible employees.
We assess candidates on their skills and the work they can show us, such as projects, research, internships, open-source or previous jobs, rather than years of experience.
S$10,700–18,700/month · EP occupation: AI Engineer
HUD builds the infrastructure for training and evaluating AI agents. Our platform lets teams create reinforcement learning (RL) environments, benchmarks and evaluations, and our marketplace connects data vendors with frontier AI labs.
You will own the design, build and quality of our internal benchmarks for AI agents.
Key responsibilities
Design realistic benchmark tasks with subject-matter experts across domains
Build infrastructure to run models and agents against benchmark tasks
Develop metrics for task difficulty, reliability and failure modes
Check that benchmark results track real-world performance and lab expectations
Write clear documentation and reports on benchmark results
Requirements
Degree in Computer Science, Engineering or a related field, or equivalent practical experience
Solid software or machine learning engineering skills, shown through work, internships, research or projects
Strong Python, Docker and Linux skills
Experience with environments, benchmarks or evaluations for ML models
Published papers or technical blog posts on related topics (please include links)
Good to have
Strong attention to detail in spotting inconsistencies and edge cases
Experience at an early-stage startup
Work location: On-site at our Singapore office, 9 Battery Road (Raffles Place). Full-time, permanent. 21 days of annual leave; CPF contributions for eligible employees.
We assess candidates on their skills and the work they can show us, such as projects, research, internships, open-source or previous jobs, rather than years of experience.
Peringatan Penting
Jangan pernah kongsikan maklumat bank atau kad kredit anda semasa memohon pekerjaan. Elakkan membuat sebarang pembayaran atau mengisi survey yang tidak berkaitan. Jika ada yang mencurigakan, sila laporkan iklan pekerjaan ini segera.