← Sottava, jobs the hour they open
Posted 8 mo agoFirst seen 1 mo ago
Audio Specialist- Freelance AI Trainer Project
Posted by Agency on 20 February 2026, 255 days ago. Still on their Greenhouse board when we checked 33 min ago. Half of Agency's roles come down within 204 days.
What the posting is about
Create and execute role-play evaluation scenarios for AI audio models. Contribute to dataset development. Evaluate model performance using specific metrics. Work remotely with a pay range of $11-$30.65 per hour.
Read out of the posting
Levelmid
Experience askedNot stated
EmploymentContract
LocationWorld Wide - Remote
RemoteYes
Visa sponsorshipNot stated
SalaryNot published, and most postings do not
Posted2026-02-20
Found viagreenhouse, direct from their system
We saw it 7 months after it went up.
The posting, as the company wrote it
A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.
Responsibilities
Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
Flight bookings and travel support
Financial services
Telecommunications and technical support
Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
Evaluate model performance across a standardized set of qualitative and quantitative metrics.
Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Evaluation Metrics
Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:
Task completion accuracy and efficiency
Conversational naturalness (tone, flow, and coherence)
Audio comprehension and response quality
Instruction adherence and contextual understanding
Basic computer programming literacy , including:
Understanding of JSON structures
Familiarity with functions and methods
Ability to reason about structured data and simple logic
Technical communication clarity when handling support-style problem-solving
Technical & Equipment Requirements
Strong verbal communication skills in a simulated customer support context
English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
Comfort working with structured prompts, evaluation rubrics, and technical guidelines
Device capable of running audio recording software and opening large technical documentation
We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Employment type: Contract
Workplace type: Remote
Seniority level: Mid‑Senior Level
Copied from Agency’s own board, not rewritten.
Also open at Agency
Why this page exists
We read companies’ own hiring systems every hour, 1,909 of them, and show a job the hour it opens instead of when a job board gets around to indexing it. We saw it 7 months after it went up.
The feed is free. No card, no trial to expire.
A free account first, no card