An opportunity is available for a Member of Technical Staff with Cortex Lab (applied AI research) expertise to support AI development and evaluation projects. There is currently 1 opening available.
Job Responsibilities
- Design and implement evaluation frameworks, benchmarks, and datasets for LLM-powered agents and complex AI workflows.
- Identify, analyze, and prioritize model, agent, and workflow failures in real-world production environments.
- Run rapid experiments to validate hypotheses, measure performance, and improve agent reliability and effectiveness.
- Partner with enterprise customers and researchers to evaluate, deploy, and optimize AI systems across production workflows.
- Develop high-quality training and evaluation data, task specifications, and feedback mechanisms to improve system performance.
- Build Python-based evaluation pipelines, experimentation tools, and lightweight research infrastructure.
- Collaborate with researchers, domain experts, and customer stakeholders to define evaluation strategies and optimization roadmaps.
- Contribute to technical reports, benchmarks, and research insights that inform future system improvements.
Compensation: $300,000 - $700,000/year.
Location / Region: Remote.
Relevant skills include:
- Ai agent evaluation & benchmark design
- Python & research engineering
- Agent failure analysis & experimentation
- Llm & agentic systems
Pamper Me Network provides this concise opportunity summary for discovery. Review the official job listing for complete qualifications, availability, current terms and any additional responsibilities before applying.
