Real-world data is the competitive edge in AI.
HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery.
We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide.
We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out.
If you want to do work that materially shapes how the next generation of AI products gets built, we'd love to talk.
Location:Remote
Type:Part-Time Contract (15+ hours per week for 2 weeks | 30 hour minimum commitment)
Duration: 2 weeks with potential for ongoing work
Compensation: $3.13 per delivered milestone of 120 tasks ( $6.25/hour equivalent)
You'll evaluate and rate graphic design elements on standardized quality scales to train AI models that assess design effectiveness—contributing to cutting-edge technology that advances how AI understands and evaluates visual content quality.
You thrive on consistency and repetition- You find satisfaction in systematic work and can maintain quality standards while evaluating similar content repeatedly without losing focus or accuracy.
You have a calibrated design eye- You can quickly assess design quality against objective criteria and apply the same standards consistently across hundreds or thousands of examples.
You're objective and principled- You separate personal taste from professional assessment, basing ratings on established design principles rather than subjective preference.
You maintain sustained focus- You can work through high volumes of repetitive tasks while staying sharp and attentive to subtle quality differences.
You're a clear communicator- You flag confusing examples or rating criteria early, ask clarifying questions, and document edge cases clearly.
You're curious about technology- You're genuinely interested in how AI learns to evaluate design quality and see value in contributing to machine learning training data.
HumanSignal enables data science teams to build AI models with their company DNA. With the emergence of generative AI, it’s more important than ever to build highly differentiated models by guiding foundation models with proprietary data and human feedback. Creators of Label Studio, the most popular open source data labeling platform, HumanSignal enables data scientists to develop high quality datasets and workflows for model training, fine tuning and continuous validation.
Today, the Label Studio open source community has more than 250,000 users who have collectively annotated more than 100 million pieces of data. Label Studio Enterprise is available as a cloud service with enhanced security, automation, quality review workflows, and performance reporting, used by leading data science teams including Bombora, Geberit, Outreach, Wyze, and Zendesk.
