Back to Jobs

AI Output Evaluator

Confidential employer

Posted 10/1/2026Rate visible after sign-upSource: Curated from source
English Proficiency
Quality Assurance
AI Tools
About the Role

AI Output Evaluator

We are looking for a detail-oriented, highly disciplined Independent Contractor to evaluate AI-generated outputs (images, videos, audio, and text) for a U.S.-based AI training project.

The Work:
You will compare two AI-generated responses side-by-side and determine which one better satisfies a specific prompt based on observable evidence. You will be trained on our strict evaluation rubric and expected to write brief, evidence-based justifications for your choices.

Technical Requirements (Mandatory):

  • All work MUST be performed on a provided AWS Virtual Machine (VM) accessed via Remote Desktop Protocol (RDP).
  • You are strictly prohibited from using your personal computer, personal browser, or personal storage devices for task work.
  • You must have a stable internet connection capable of maintaining a consistent RDP connection.
  • You may not install any software on the AWS VM.

Compliance & Rules (Zero Tolerance):

  • You must only work on tasks you are authorized to do (we will provide required attributes).
  • You must log accurate active work hours. Time fraud (logging hours not actively worked) is grounds for immediate termination.
  • Absolutely no use of ChatGPT, Claude, or any external AI tools to assist with evaluations.
  • Strict confidentiality is required. You may not screenshot, copy, or share any task materials.
  • Maximum 14 hours per day / 40 hours per week.

Schedule & Pay:

  • Full-time: 40 hours per week (M–F 8 hours/day preferred, but flexible as long as 40 hours are reached).
  • Pay is structured as a revenue share equivalent to $4.50 per hour of active work on the AI platform.
  • First week: $100 paid once 24 active hours are reached, and the remaining $80 paid at week's end.
  • Ongoing: Weekly payouts processed by Handshake AI on Wednesdays (covering Mon–Sun of the previous week), taking 24–48 hours to clear.
  • No taxes are withheld. You are responsible for your own taxes.

To apply: Please confirm you understand that this is a 1099 Independent Contractor role, that you can strictly follow the AWS VM/RDP requirement, and that you are comfortable with the revenue-share pay structure.

Track this external role

Sign in to save this listing and apply through the original source.

Sign in to SaveReport JobOpen Original Listing