AI Output Evaluator
Confidential employer
AI Output Evaluator
We are looking for a detail-oriented, highly disciplined Independent Contractor to evaluate AI-generated outputs (images, videos, audio, and text) for a U.S.-based AI training project.
The Work:
You will compare two AI-generated responses side-by-side and determine which one better satisfies a specific prompt based on observable evidence. You will be trained on our strict evaluation rubric and expected to write brief, evidence-based justifications for your choices.
Technical Requirements (Mandatory):
- All work MUST be performed on a provided AWS Virtual Machine (VM) accessed via Remote Desktop Protocol (RDP).
- You are strictly prohibited from using your personal computer, personal browser, or personal storage devices for task work.
- You must have a stable internet connection capable of maintaining a consistent RDP connection.
- You may not install any software on the AWS VM.
Compliance & Rules (Zero Tolerance):
- You must only work on tasks you are authorized to do (we will provide required attributes).
- You must log accurate active work hours. Time fraud (logging hours not actively worked) is grounds for immediate termination.
- Absolutely no use of ChatGPT, Claude, or any external AI tools to assist with evaluations.
- Strict confidentiality is required. You may not screenshot, copy, or share any task materials.
- Maximum 14 hours per day / 40 hours per week.
Schedule & Pay:
- Full-time: 40 hours per week (M–F 8 hours/day preferred, but flexible as long as 40 hours are reached).
- Pay is structured as a revenue share equivalent to $4.50 per hour of active work on the AI platform.
- First week: $100 paid once 24 active hours are reached, and the remaining $80 paid at week's end.
- Ongoing: Weekly payouts processed by Handshake AI on Wednesdays (covering Mon–Sun of the previous week), taking 24–48 hours to clear.
- No taxes are withheld. You are responsible for your own taxes.
To apply: Please confirm you understand that this is a 1099 Independent Contractor role, that you can strictly follow the AWS VM/RDP requirement, and that you are comfortable with the revenue-share pay structure.
Track this external role
Sign in to save this listing and apply through the original source.
Sign in to SaveReport JobOpen Original Listing