DeepRoute.ai

Research Scientist - Multimodal Representation Learning

DeepRoute.ai  •  Fremont, CA (Onsite)  •  30 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

We are looking for a research scientist to push the frontier of multimodal representation learning for autonomous driving. You will focus on method-level innovation, including designing new learning paradigms, architectures, and training strategies for large-scale vision and video models.

This role is ideal for candidates who care deeply about how models learn, not just how to train them.

Responsibilities

1. Design and develop novel representation learning methods, including:

    • Self-supervised learning
    • Contrastive learning
    • Masked modeling
    • Teacher-student / distillation frameworks

2. Innovate on model architectures, including:

    • Vision Transformers (ViT)
    • Video models (e.g., Video Swin)
    • Multimodal fusion architectures

3. Develop new training paradigms and loss functions to improve representation quality

4. Drive measurable improvements in:

    • Representation quality (e.g., linear probe, retrieval metrics)
    • Downstream performance (e.g., perception / E2E driving systems)

5. Collaborate with engineering and data teams to integrate new methods into production systems

Requirements

Core Requirements

  1. Strong academic background in Computer Science, AI, or related fields
  2. Solid understanding of modern representation learning frameworks:
    • CLIP
    • DINOv2
    • Masked Autoencoders

3. Proven experience in method-level innovation, such as:

    • Designing new loss functions
    • Modifying architectures

4. Creating new training strategies

Preferred Qualifications

  1. Publications in top-tier venues:
        • CVPR
        • ICCV
        • NeurIPS
        • ICLR

2. Experience training models at scale using:

        • DeepSpeed / Megatron-LM

3. Strong intuition for why models behave the way they do, not just how to train them

DeepRoute.ai

About DeepRoute.ai

Founded in February 2019, DeepRoute.ai is a leading artificial intelligence company dedicated to the research, development and application of autonomous driving technology. As data accumulation and technology iterations continue, DeepRoute.ai aims to create general artificial intelligence in robots, bringing new productivity to humanity.

Industry
IT & Software
Company Size
51-200 employees
Headquarters
Fremont, California
Year Founded
2019
Social Media