Job Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Humanities / Arts / Culture Evaluator based in Canada.
This contract opportunity is designed for an experienced humanities, arts, or culture professional with strong analytical and evaluative skills. You will assess AI-generated content against detailed quality standards, applying your subject-matter expertise to determine accuracy, relevance, and overall quality. Your perspective will help identify factual inaccuracies, aesthetic shortcomings, and presentation issues that may not be apparent through automated evaluation alone. You will provide structured, actionable feedback that supports the improvement of AI-generated outputs and training data. The role combines professional judgment, cultural awareness, critical thinking, and attention to detail. Working remotely and asynchronously, you will contribute to the development of more accurate, nuanced, and reliable AI systems.
Accountabilities:
- Evaluate AI-generated documents, presentations, spreadsheets, and other content against established quality rubrics and domain-specific standards.
- Apply humanities, arts, and cultural expertise to assess the accuracy, relevance, context, quality, and appropriateness of AI-generated outputs.
- Identify factual inaccuracies, cultural inconsistencies, aesthetic issues, presentation problems, and other quality concerns.
- Provide clear, structured, and actionable written feedback to help improve AI-generated content and model performance.
- Assess outputs objectively and consistently while applying professional and subject-matter judgment.
- Collaborate with AI research teams to identify opportunities to improve training-data quality and evaluation methodologies.
- Maintain high standards of accuracy, consistency, and attention to detail across evaluation assignments.
- Work independently and asynchronously while meeting deadlines and delivering reliable, high-quality evaluations.
Requirements:
- 5+ years of relevant professional experience in humanities, arts, culture, cultural studies, or a closely related field
- Native or professional-level fluency in English, with strong written and verbal communication skills.
- Strong subject-matter expertise and the ability to evaluate content through an informed cultural, historical, artistic, or humanities-focused perspective.
- Excellent critical-thinking and analytical skills, with the ability to assess nuanced content objectively.
- Strong attention to detail and the ability to identify factual, contextual, aesthetic, and presentation-related issues.
- Ability to provide concise, structured, and constructive written feedback based on defined evaluation criteria.
- Highly proficient in Microsoft Office and Google Workspace, particularly presentation tools such as Google Slides.
- Comfortable working independently in a remote, asynchronous environment and managing deadlines effectively.
- An advanced degree, such as a Master’s degree or higher, from a reputable institution is preferred.
Benefits:
- Competitive contract compensation of $80–$120 per hour
- Fully remote work environment.
- Flexible, asynchronous working structure.
- Opportunity to apply specialized humanities, arts, or cultural expertise to emerging AI technologies.
- Meaningful contribution to improving the accuracy, nuance, relevance, and quality of AI-generated content.
- Opportunity to collaborate with AI research teams and contribute to high-quality training data.
- Exposure to evolving AI evaluation methodologies and research workflows.
- Independent work environment with flexibility around managing assignments and deadlines.
How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1
