An opportunity is available for a Member of Technical Staff with Realm Lab (frontier AI research) expertise to support AI development and evaluation projects. There is currently 1 opening available.
Job Responsibilities
- Own research and evaluation initiatives end-to-end, from task design and dataset development to benchmark validation and performance analysis.
- Design and validate capability evaluations, RL environments, and benchmark suites for computer use, agentic workflows, and emerging model capabilities.
- Develop high-quality datasets, task specifications, evaluation rubrics, and methodologies to improve post-training data quality and model assessment.
- Analyze model behavior through failure analysis, error taxonomies, and capability gap identification to inform research directions.
- Collaborate with researchers and domain experts to design experiments, calibrate evaluation quality, and improve model performance.
- Build reproducible evaluation pipelines and feedback loops to support iterative model development.
- Contribute to benchmarks, research papers, technical reports, and open research artifacts.
Compensation: $600,000 - $2,000,000/year.
Location / Region: Remote.
Relevant skills include:
- Llm evaluation & benchmark design
- Python & ml engineering
- Reinforcement learning & agentic systems
- Model failure analysis & research methodology
Pamper Me Network provides this concise opportunity summary for discovery. Review the official job listing for complete qualifications, availability, current terms and any additional responsibilities before applying.
