An opportunity is available for a Data Science & Analytic Methodology SME to support AI development and evaluation projects. There are currently 3 openings available.
Job Responsibilities
- Map scaled-analysis and pipeline-integration scenarios to an established taxonomy across key evaluation areas.
- Author detailed analytic cases that reflect authentic deployment patterns, including automated triage, enrichment, and analysis-at-scale, as well as representative failure modes in real-world settings.
- Evaluate and grade responses based on criteria such as source handling, reasoning, understanding of limitations, and practical utility.
- Identify and flag instances of model over-refusal that could hinder legitimate analytic workflows or disrupt pipeline continuity.
- Document challenging edge cases, emerging methodology concerns, and provide actionable recommendations for continuous improvement.
- Contribute clear, insightful written and verbal feedback that supports iterative, high-quality project outcomes.
Compensation: $60 - $100/hr.
Location / Region: Remote.
Relevant skills include:
- Llms
- Pipeline integration
- Data analytics
- Scaled-analysis judgment
- Data science
Pamper Me Network provides this concise opportunity summary for discovery. Review the official job listing for complete qualifications, availability, current terms and any additional responsibilities before applying.
