Job Description

Accountabilities:

• Test and evaluate AI chatbots and language models through structured conversations based on assigned goals, prompts, and evaluation criteria.
• Assess AI responses for quality, accuracy, helpfulness, safety, relevance, and naturalness in Kannada.
• Ask thoughtful follow-up questions and engage with AI models in a way that helps identify strengths, weaknesses, and potential areas for improvement.
• Participate in voice-based AI evaluations when required, using clear and natural Kannada pronunciation; sessions may be recorded and shared with the project client as part of the evaluation deliverables.
• Complete assigned project tasks according to the specific requirements and Statement of Work (SOW) provided before each engagement.
• Submit accurate deliverables such as written evaluations, ratings, screenshots, audio recordings, or other materials specified for the project.
• Follow project guidelines, quality standards, confidentiality requirements, and technical instructions consistently.
• Communicate responsively with the project team and complete onboarding and assigned tasks within required timelines.
• Be prepared to participate in future projects where your Kannada language expertise and AI evaluation skills are relevant.

Requirements:

• Native or expert-level proficiency in Kannada as spoken in India, equivalent to approximately C2-level proficiency.
• Strong English reading, writing, and communication skills; an English proficiency assessment may be required.
• At least 18 years of age.
• Hands-on experience using generative AI tools, AI chatbots, or large language models.
• Comfortable communicating through both written and voice-based interactions, with the ability to ask precise and insightful follow-up questions.
• Strong critical thinking, attention to detail, and the ability to evaluate AI-generated content objectively.
• Access to your own smartphone and computer/laptop, along with a reliable internet connection and comfort using web-based tools.
• Ability to successfully complete required language proficiency and technical literacy assessments.
• Strong responsiveness and communication skills, particularly during onboarding and active project periods.
• Availability to begin within 48 hours of being selected.
• Willingness to complete identity verification, which may require submitting a photograph and an image of an identity document.
• Professional voice recording experience or experience requiring clear, neutral pronunciation is advantageous.
• Previous experience in AI projects, transcription, translation, localization, linguistic analysis, or similar language-focused work is a plus.
• Comfort completing tasks that may involve short video recordings, including recordings that may show your face or objects, depending on project requirements.
• An Upwork account, or willingness to create one if required for the engagement.

Benefits:

• $8 USD per hour for completed project work.
• Flexible, task-based independent contractor engagement.
• Choose which available tasks to accept and set your own working hours.
• Work remotely from anywhere in India.
• Freedom to work with other clients or alongside other professional commitments.
• Apply once and remain in consideration for future projects matching your language skills and experience.
• No fixed ongoing schedule or micromanagement; project requirements and task specifications are provided clearly in advance.
• Opportunity to gain practical experience working on AI evaluation and language technology projects.
• Contribute directly to improving how generative AI systems understand and interact with Kannada.
• Exposure to projects involving AI evaluation, linguistic analysis, voice interaction, and language data.
• Flexible project availability, with work delivered in batches and potential pauses between project phases.
• Equal opportunity engagement with a focus on diversity and inclusion across the global workforce.