Remote Search Engine Evaluator - English Job at Scale AI, Arlington, TX

  • Scale AI
  • Arlington, TX

Job Description

Salary: $31,200 - 31,200 per year Requirements:

  • Fluent in English, with strong written communication and comfort speaking naturally in everyday conversations.
  • Strong attention to detail and patience when reviewing audio and visual content, including replaying or zooming in to inspect issues.
  • Ability to think on your feet and discuss realistic scenarios conversationally.
  • Experience writing concise, evidence-based explanations or reviews.
  • Ability to make a clear choice when both options have flaws.
  • A bachelors degree or higher is a plus.
  • To sign up, you need a valid ID and mobile phone from your country of residence, an up-to-date resume highlighting your expertise, and a LinkedIn profile showing your education and work experience.
  • You must be authorized to work in your country of residence.
  • Applicants are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.
Responsibilities:
  • Hold live, scenario-based English conversations with AI voice models and assess how natural, useful, and clear their responses are.
  • Compare AI-generated images and videos, judging which better follows the prompt.
  • Inspect outputs closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video.
  • Rate outputs for qualities such as prompt adherence, quality, and realism, and write specific English explanations supported by what you observed.
  • Compare generated images for instruction-following, visual quality, and AI artifacts; some assignments involve ranking edited images against originals.
  • Rank generated videos against prompts or edited videos against their source clips.
  • Label first-person videos of people or robots performing hands-on tasks by dividing clips into individual actions and writing precise captions, correcting AI-generated drafts as needed.
  • Evaluate generated speech for naturalness, pronunciation, and similarity to a target voice; some assignments require recording a short spoken explanation.
Technologies:
  • AI
  • Mobile

More:

Outlier is an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI model performance, helping improve how advanced systems reason, learn, and perform in real-world settings. This remote freelance work can be done from anywhere at any time, with no minimum hours and a self-set schedule. Project work pays up to USD $15 per hour, with rates varying according to expertise, skills assessment, location, project needs, and other factors. Contributors may also receive Missions incentives; payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. We provide free access to leading LLMs valued at over $200 per month and opportunities to collaborate with experts on pre-release models. Our community includes more than 900,000 experts across 52 countries, and we have paid more than $600 million to experts. This is a 1099 contract opportunity: contributors join us as freelancers or independent contractors, not employees. We do not offer internships, sponsorship, or employment through this opportunity. International students may be able to sign up while on a visa; individual tax or immigration questions should be directed to an appropriate advisor.

last updated 44 week of 2026

Job Tags

Hourly pay, Full time, Contract work, For contractors, Work experience placement, Freelance, Internship, Remote work

Similar Jobs

RWS

Search Engine Evaluator - Spanish (United States) Job at RWS

 ...Are you a web-savvy, search expert with a talent for finding things online by using just a few words? Do you want to...  ...on board! Working on behalf of RWS, you will test and evaluate how our clients search engine responds to everyday searches from everyday people.... 

Bank of Hawaii

Compliance Officer Job at Bank of Hawaii

Under the direction of the Manager, this position is responsible for assisting in the development and execution of all compliance and operational risk activities. This position assists in managing the day-to-day compliance activities and programs, develop and maintain... 

Providence

Interventional Radiology (IR) and Senior Interventional Radiology (IR) Technologist Job at Providence

 ...This posting is for multiple full time openings at St Peter's Hospital Olympia, WA Providence is dedicated to delivering high-quality...  ...harassment on the basis of race, color, gender, disability, veteran, military status, religion, age, creed, national origin, sexual... 

Soccer Shots

Morning Toddler Soccer Coach Job at Soccer Shots

 ...family business at heart. We aim to develop each of our coaches in areas including leadership, early childhood education, and sports management. Benefits: Flexible schedule Free uniforms Training & development Why coach for Soccer Shots? ~ Best-... 

TransPak

Rigger Job at TransPak

 ...or the ability to get certified Valid driver's license and ability to be insured as needed Significant work experience as a rigger, 2+ years minimum Experienced with crane assembly and disassembly Good math skills for calculating load requirements Knowledge...