Cinemo

Working Student – GenAI / LLM Evaluation – Agentic AI / NLP (f/m/d)

Cinemo  •  Karlsruhe, DE (Onsite)  •  4 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

As a Working Student in the GenAI / LLM team at Cinemo, you will support the evaluation and validation of agentic AI systems and GenAI algorithms for NLP that power next-generation in-car experiences. You will help build datasets, extend evaluation tooling, and contribute to end-to-end testing workflows to ensure our non-deterministic AI components are measurable, reliable, and ready for real-world automotive environments across cloud-based services and in-vehicle platforms such as Android Automotive OS (AAOS) and Linux.

In this role, you will:

  • Support evaluation of agentic AI systems and LLM-based NLP features, including qualitative and quantitative analysis.
  • Create, curate, and maintain datasets for benchmarking, regression testing, and scenario coverage.
  • Extend and improve internal evaluation frameworks (metrics, dashboards, automated test runs).
  • Contribute to end-to-end testing of GenAI features within the in-car experience, including integration and validation workflows.
  • Document findings, track model/system changes, and communicate results clearly to the team.
  • Collaborate with engineers and researchers to translate evaluation insights into actionable improvements.

What you will need to succeed:

  • Ongoing Bachelor’s or Master’s studies in Computer Science, AI/ML, Data Science, Computational Linguistics, or a related field.
  • Hands-on programming skills in Python and a solid understanding of basic ML/NLP concepts.
  • Interest in GenAI / LLMs, agentic systems, and evaluation of non-deterministic AI behavior.
  • Experience with data handling and dataset creation (labeling, preprocessing, quality checks).
  • Familiarity with software testing concepts (e.g., unit/e2e testing, CI) is a plus.
  • Good written and spoken English communication skills.
Cinemo

About Cinemo

Cinemo is a global provider of highly innovative infotainment products that make every screen an opportunity. Its range of award-winning, fully integrated, low-footprint digital media offerings combine high performance with high quality and are truly system agnostic. Whether embedded, as mobile apps or through the cloud, Cinemo supports all digital media scenarios for any industry and any device. Its product portfolio is designed and built to deliver excellence, accelerate time to market, and lower TCO for its clients while creating digital media experiences that matter.

Founded in 2008, and with a strong history of industry firsts, Cinemo is the partner of choice for more than 40 market-leading OEMs and over 20 tier-1s. The company works with the top high-tech and consumer electronic companies as well as global music and video content providers. Cinemo’s global team of 300+ innovative thinkers from 40 nationalities continuously delivers groundbreaking innovation.

Industry
Unknown
Company Size
201-500 employees
Headquarters
Karlsruhe, DE
Year Founded
2008
Social Media