Pick a task. Make a model less wrong.
Each task is a small, paid judgment call. Some items are probes — their ground truth is held aside to grade how you call the rest. You won't know which.
- T-2041 hotWhich reply sounds like a human who cares?
A grieving customer just messaged a brand. Two AI replies. Pick the one that doesn't sound trained.
ToneAnywhere$0.38per item1m8,400 openTier 1 - T-2068Apology: genuine or PR?
Two corporate apology drafts after a service outage. Mark which would actually calm a furious customer.
ToneAnywhere$0.42per item1m4,220 openTier 1 - T-2107Idiomatic Korean → English
Pick the translation that lands the joke without explaining it. Native or near-native KR/EN.
TranslationAnywhere$0.75per item3m1,240 openTier 2 - T-2118Spanish → English: keep the warmth
A grandmother's voice note about a great-grandchild. Which translation keeps the affection?
TranslationAnywhere$0.70per item3m510 openTier 2 - T-2199On-brand or off?
Three product images. One is on-brand for a calm Scandinavian skincare label. Pick it.
AestheticAnywhere$0.60per item2m3,120 openTier 1 - T-2208Code review: kind or rude?
An AI's PR comment for a junior engineer's first month. Mark whether it would land.
Code reviewAnywhere$1.20per item4m410 openTier 2 - T-2244Variable name taste
Four suggested names for the same function. Pick the one a calm staff engineer would land on.
Code reviewAnywhere$0.85per item2m660 openTier 2 - T-2310 hotDid the AI hear what you heard?
Listen to a 12-second clip. Did the assistant catch the actual feeling, or just the words?
AudioHeadphones$0.90per item2m720 openTier 2 - T-2333Tamil wedding invite — would it get teased?
Three generated invites for a Tamil family wedding. Pick the one that wouldn't draw side-eye.
CulturalAnywhere$1.10per item3m290 openTier 2 - T-2356Third-gen Mexican-American baby names
Five generated name sets. Mark the one that sounds like a real family, not a list.
CulturalAnywhere$0.95per item3m130 openTier 2 - T-24011970s family photo — real or stock?
Five AI-generated images. Mark which actually look like 1970s family photos and not stock simulations.
ImageAnywhere$0.70per item2m2,010 openTier 1 - T-2444Editorial edit, not rewrite
Two edits of the same paragraph. One respects the writer's voice. Choose it and explain in 8 words.
EditorialQuiet space$1.45per item5m88 openTier 3 - T-2469Bedtime story or lecture?
Read the generated children's story. Mark the moment it stops sounding like a story.
EditorialQuiet space$0.95per item4m320 openTier 2 - T-2510Microcopy that doesn't talk down
Four CTA buttons for a calm savings app. Pick the one that nudges without scaring.
MicrocopyAnywhere$0.45per item1m5,600 openTier 1 - T-2526Onboarding line — kind or condescending?
Three first-screen lines for a tax-prep app's first-time users. Pick the one that doesn't make you feel stupid.
MicrocopyAnywhere$0.50per item1m4,180 openTier 1 - T-2611 hotRefusal: right, hedged, or paranoid?
Five AI responses to ambiguous safety prompts. Score each: right, hedged, or paranoid.
SafetyQuiet space$1.75per item6m60 openTier 3 - T-2655Pediatric tone — leaves room?
AI replies to an anxious parent. Score whether the response leaves room for them to keep talking.
ClinicalQuiet space$2.00per item6m48 openTier 3 - T-2682Plain-language law — clear without patronizing
Two AI explanations of a tenancy clause for a layperson. Pick the one that doesn't talk down.
LegalQuiet space$1.65per item5m72 openTier 3 - T-2705Recipe: grandmother or search engine?
An AI rewrote a family stew. Read it. Would it taste like home, or like a content farm?
RecipeAnywhere$0.80per item3m940 openTier 1 - T-2741Knitting pattern — written by a knitter?
Three pattern descriptions. Mark the one written by someone who's actually knit it.
CraftAnywhere$1.00per item4m88 openTier 2 - T-2812Counter-offer: firm without rude
Three salary counter-offers in email. Pick the firmest one that doesn't burn the relationship.
NegotiationAnywhere$1.30per item4m220 openTier 2 - T-2841Saying no to a friend's bad idea
Three drafts replying to a friend's startup pitch you don't believe in. Honest without ending the friendship.
SocialAnywhere$0.75per item3m410 openTier 1 - T-2904Lo-fi 'Sunday afternoon' — which clip?
Three 20-second music clips. Pick the one that's most 'Sunday afternoon, working alone'.
AudioHeadphones$0.60per item2m1,120 openTier 1 - T-3011Thoughtful gift for a 12-year-old builder
Five AI gift suggestions for a kid who likes taking things apart. Mark the thoughtful one.
SocialAnywhere$0.65per item2m1,730 openTier 1