About the Company Outlier is an AI training platform owned and operated by Scale AI. Through a network of experts working on different projects, Outlier helps generate training data and evaluate AI model performance. Its platform connects contributors with projects that support the development and improvement of advanced AI systems. About the Role Outlier is seeking detail-oriented, fluent English speakers to evaluate AI-generated images, videos, and audio. As an independent contractor, you will review AI-generated content, participate in live conversations with AI voice models, compare outputs against written prompts, and provide clear written feedback on quality, accuracy, and realism. Tasks may include identifying visual inconsistencies, evaluating speech quality, labeling actions in videos, and assessing how well AI-generated content follows instructions. Work is fully remote, with no minimum weekly hours. Contributors can choose their own schedules and work on available projects based on their skills and qualifications. Key Responsibilities Hold live, scenario-based conversations in English with AI voice models and evaluate how natural, useful, and clear the responses sound. Compare pairs of AI-generated images and videos to determine which better follows the given prompt. Inspect generated content closely, including zooming in on images and replaying videos or audio, to identify visual and sound-related issues. Identify problems such as distorted anatomy, flickering, unnatural movement, text errors, and audio that does not match the video. Rate outputs across criteria such as prompt adherence, quality, and realism. Write specific, evidence-based explanations in English describing issues identified during evaluations. Evaluate AI-generated images against text prompts and, where required, compare edited images with their original versions. Assess AI-generated videos against prompts or compare edited videos with their source clips. Label first-person videos showing people or robots performing hands-on tasks by dividing clips into individual actions and writing accurate captions, using AI-generated drafts as a starting point. Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice. Record short voice explanations of evaluation decisions when required. Required Qualifications Fluent English communication skills, including clear written communication and comfortable everyday conversational speech. Strong attention to detail and patience when reviewing images, videos, and audio. Ability to communicate naturally during realistic, scenario-based conversations. Experience writing short, evidence-based explanations or reviews. Ability to make clear decisions when comparing outputs, even when both options have shortcomings. Ability to inspect content carefully and identify specific quality issues. Preferred Qualifications Currently pursuing or holding a bachelor's degree or higher is an advantage. Registration Requirements A valid identification document and mobile phone from your country of residence. An up-to-date resume highlighting your expertise. A LinkedIn profile showing your educational background and work experience. Location and Work Arrangement Fully remote freelance opportunity through the Outlier.ai platform. Applicants are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States. Contributors can set their own schedules and work without a minimum weekly hour requirement. Work availability depends on project needs. Compensation and Payment Project earnings Up to USD $15 per hour. Additional incentives are available through Missions, Outlier's version of surge pricing. Contributors earn an average additional 7.5% through Missions, while the top quartile earns an average additional 11%. Payments are processed weekly on Tuesdays for tasks completed during the previous payment period, which runs from Tuesday through Monday at midnight UTC. Available payment methods include PayPal, AirTM, and ACH transfer. Rates vary based on expertise, skills assessment, location, project requirements, and other factors. Higher rates may be available for certain qualifications, such as a PhD. Lower rates apply to some non-core work, including initial project onboarding and project overtime phases. Some projects offer additional incentive payments. Payment terms should be reviewed for each project. Incentive figures are based on payments made over the previous six months and are updated quarterly. Additional Benefits Free access to leading large language models (LLMs), valued at more than $200 per month. Opportunity to work with experts across different fields on pre-release AI models. Access to a contributor network of more than 900,000 Outlier Experts across 52 countries, with over $600 million paid to experts. Employment Type and Work Authorization This is a 1099 contract opportunity. Contributors join Outlier as freelancers or independent contractors, not employees. Internships, employment sponsorship, and visa sponsorship are not offered. Applicants must be authorized to work in their country of residence. International students may be eligible to sign up depending on their visa status. Candidates with questions about their individual tax or immigration circumstances should consult a qualified tax or immigration advisor.
Share
Share