UX Research Production Reviewer

AuraOne Human Data is seeking a UX Research Production Reviewer to evaluate AI-generated responses for correctness in real-world UX research production specialist operations. This remote contractor role focuses on workflow accuracy, policy adherence, stakeholder fit, and operational risk, with structured grading and clear next-step guidance for the modeling team.

Role Overview

The reviewer assesses AI outputs against established UX research production specialist operations workflows, playbooks, and firm policy. Each assignment uses a rubric to grade tone, escalation logic, and how well the response aligns with stakeholder expectations. Reviewers also handle disputed treatments by adjudicating against published playbooks or firm guidance. The output includes severity-tagged issue reporting and a clearly captured next step that the modeling team can use for training.

Key Responsibilities

• Review AI outputs against current UX research production specialist operations workflow requirements, including playbooks and rules for UX Research Production Reviewer assignments.
• Grade response tone, escalation logic, and stakeholder fit using a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the correct next step so the modeling team can train on the appropriate treatment.
• Adjudicate disputed treatments by comparing reviewer disagreement against published playbooks and firm guidance.
• Maintain reviewer-quality scores through inter-rater calibration cycles.

What You’ll Do (Example Tasks)

• Grade an AI response for a real UX research production specialist operations ticket, including workflow, tone, and escalation.
• Identify a missed escalation, apply the appropriate severity tag, and provide the corrected next step.
• Resolve a disputed playbook call between two reviewers using firm guidance.
• Audit a batch (for example, a 25-row set) for rubric consistency and report drift to the program lead.

Requirements

• Direct working experience in UX research production specialist operations on real teams for UX Research Production Reviewer work.
• Ability to apply multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail, including the ability to flag when the prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.

Additional Qualifications (Nice to Have)

• Prior experience training, calibrating, or QA-ing operations teams.
• Familiarity with AI-assisted workflow tooling and its failure modes.
• Bilingual experience for cross-region operations.

Skills

• Operational review
• Policy adherence
• Workflow judgment
• Stakeholder communication
• UX Research Production specialist operations
• Production quality
• Design critique
• Research

Work Model and Eligibility

• Remote (US-eligible)
• Remote, independent specialist contractor
• Employment type: CONTRACTOR
• Applicants must be authorized to work from the US

Compensation

Hourly rate is confirmed after the interview process.

Application Process

• Apply through AuraOne’s specialist intake for role-specific routing and review.
• Final project scope, schedule, and contractor terms are confirmed before placement.