Job Description

Accountabilities:

• Develop realistic scenarios covering rapid prototyping, UX/UI design, design-system development, component libraries, and cross-functional product-design-engineering collaboration.
• Create tasks involving AI-assisted application development, natural-language-to-code workflows, rapid prototyping, and modern product design practices.
• Design evaluation scenarios that reflect real-world challenges faced by senior product designers, design leads, and AI-native development teams.
• Use tools such as Figma, Framer, Cursor, Claude Code, v0, Replit, and related design or AI-assisted development platforms where appropriate.
• Apply human-centered design principles, iterative prompt-driven development practices, rapid prototyping methodologies, and design-system best practices.
• Develop structured rubrics that distinguish authentic senior-level product and UX/UI judgment from generic, theoretical, or tutorial-level responses.
• Assess usability, interaction design, visual hierarchy, consistency, accessibility, product thinking, and the practical feasibility of proposed solutions.
• Incorporate design-system and component-library considerations into evaluation criteria and scenarios.
• Work independently and asynchronously while maintaining high standards for accuracy, consistency, and relevance.
• Contribute to the improvement of AI model performance by providing high-quality scenarios, rubrics, and expert-level evaluation guidance.

Requirements:

• 5+ years of professional experience as a Product Designer, UX/UI Designer, Design Lead, Design Systems Specialist, or AI-native Engineer/Vibecoder within a product- or design-focused organization.
• Demonstrated ownership of production-shipped product designs, design systems, component libraries, or AI-assisted development workflows.
• Strong expertise in UX/UI design, human-centered design principles, interaction design, prototyping, and digital product development.
• Hands-on fluency with modern design and prototyping tools such as Figma and Framer, along with familiarity with AI-assisted development tools such as Cursor, Claude Code, v0, or Replit.
• Understanding of rapid prototyping, design systems, component architecture, and collaboration between design, product, and engineering teams.
• Ability to evaluate design solutions from both user and business perspectives, balancing usability, feasibility, consistency, and product objectives.
• Strong analytical and critical-thinking skills, with the ability to distinguish nuanced senior-level design judgment from generic recommendations.
• Strong written communication skills and the ability to articulate design decisions, evaluation criteria, and feedback clearly.
• Comfortable working independently, asynchronously, and with structured evaluation frameworks.
• A portfolio demonstrating shipped product or UX/UI work is strongly preferred.
• Previous experience authoring rubrics, training materials, design critiques, or AI evaluation content is an advantage.

Benefits:

• Competitive contract compensation of $70–$80 per hour
• Fully remote work environment.
• Flexible, asynchronous working structure.
• Opportunity to apply UX/UI and product design expertise to emerging AI technologies.
• Exposure to AI-assisted development, natural-language-to-code workflows, rapid prototyping, and modern design systems.
• Opportunity to contribute to the development of more capable and reliable AI systems through expert-led evaluation.
• Work on diverse scenarios spanning product design, design systems, prototyping, and AI-native development.
• Independent environment with flexibility around managing assignments and deadlines.
• Opportunity to apply real-world, production-level design expertise to cutting-edge AI evaluation workflows.