Note: The job is a remote job and is open to candidates in USA. Prolific is building the biggest pool of quality human data in the world, serving over 35,000 AI developers and organizations. The AI Trainer - Concierge role involves training and evaluating AI models by reviewing AI-generated responses, comparing model answers, and providing structured feedback to improve the models.
Responsibilities
- Reviewing AI-generated responses to scenarios a Concierge would face and rating them for accuracy, appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Skills
- Verified status as a Concierge (e.g., by providing a professional profile that shows both educational and professional experience)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients
Company Overview
Building the most advanced global infrastructure for People Science. It was founded in 2014, and is headquartered in Oxford, Oxfordshire, GBR, with a workforce of 51-200 employees. Its website is https://www.prolific.com/.Company H1B Sponsorship
Prolific has a track record of offering H1B sponsorships, with 11 in 2025, 7 in 2024, 16 in 2023, 39 in 2022, 16 in 2021, 8 in 2020. Please note that this does not guarantee sponsorship for this specific role.
Apply Now