Job Description

Role Title: AI Agent Power User

Role Type: Contract

Location: Remote (US, CA, UK, IE, AU, NZ)

In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

• Run complex, multi-step business scenarios using AI assistants such as ChatGPT and Claude, reflecting genuine professional workflows.
• Document each step, highlighting where AI performance aligns with or diverges from realistic business needs.
• Evaluate and score AI-generated outputs using specified rubrics and criteria, focusing on quality, completeness, and relevance.
• Draft clear, constructive, and actionable feedback based on rubric findings to inform AI research and product teams.
• Identify recurring patterns in AI behavior—strengths, weaknesses, and opportunities for process improvement.
• Connect AI tools to frequently used workplace platforms (e.g., Google Drive, Gmail, Slack, Notion) to mirror authentic use cases.
• Maintain meticulous written records and communicate findings in professional English, ensuring transparency and reproducibility.

Preferred Qualifications

• 5+ years of professional experience in any business function, utilizing technology to solve operational challenges.
• Completed Bachelor’s degree or higher in any discipline.
• Consistent, hands-on daily use of ChatGPT and/or Claude for actual work, not just experimentation.
• Experience grading, applying, or creating evaluation rubrics, QA scorecards, or content review guidelines (academic, QA, hiring, or annotation experience strongly valued).
• General comfort integrating AI tools with business software and productivity platforms.
• Demonstrated excellence in written English, with a focus on clear, actionable documentation and feedback.
• Authorized for contract work and based in the US, Canada, UK, Ireland, Australia, or New Zealand (US strongly preferred).