Note: The job is a remote job and is open to candidates in USA. Prolific is building the biggest pool of quality human data in the world, and they are seeking Industrial Engineers to help train and evaluate cutting-edge AI models. The role involves reviewing AI-generated responses, rating them for accuracy, and providing structured feedback to improve model performance.
Responsibilities
- Reviewing AI-generated responses to engineering scenarios and rating them for accuracy, appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Skills
- Verified status as a Industrial engineer (e.g., by providing a professional profile that shows both educational and professional experience)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients
Benefits
- Flexible hours
- The ability to work from home
Company Overview
- Building the most advanced global infrastructure for People Science. It was founded in 2014, and is headquartered in London, England, GBR, with a workforce of 51-200 employees. Its website is https://www.prolific.com/.
Company H1B Sponsorship
- Prolific has a track record of offering H1B sponsorships, with 12 in 2025, 7 in 2024, 16 in 2023, 39 in 2022, 16 in 2021, 8 in 2020. Please note that this does not guarantee sponsorship for this specific role.