Le CEA est un acteur majeur de la recherche, au service des citoyens, de l'économie et de l'Etat.
Il apporte des solutions concrètes à leurs besoins dans quatre domaines principaux : transition énergétique, transition numérique, technologies pour la médecine du futur, défense et sécurité sur un socle de recherche fondamentale. Le CEA s'engage depuis plus de 75 ans au service de la souveraineté scientifique, technologique et industrielle de la France et de l'Europe pour un présent et un avenir mieux maîtrisés et plus sûrs.
Implanté au cœur des territoires équipés de très grandes infrastructures de recherche, le CEA dispose d'un large éventail de partenaires académiques et industriels en France, en Europe et à l'international.
Les 20 000 collaboratrices et collaborateurs du CEA partagent trois valeurs fondamentales :
2026-41976
Based in Saclay (Essonne), the LIST is one of the two institutes of CEA Tech, the Technological Research Division of the CEA. Dedicated to intelligent digital systems, its mission is to carry out technological developments of excellence on behalf of industrial partners, in order to create value.
Within the LIST, the Laboratory of Vision for Modeling and Localization (LVML) conducts its research in the field of computer vision and artificial intelligence for the perception of intelligent and autonomous systems. The laboratory's research themes include 3D localization, segmentation, characterization and vision for robotics.
Mathématiques, information scientifique, logiciel
Stage
Stage - Training networks to be compressible: low rank, quantization, and how they combine-Saclay-H/F
To run on smaller hardware or serve more cheaply, large neural networks are often compressed before deployment: most commonly by quantization (storing numbers with few bits), less often by low-rank factorization (replacing a weight matrix by a product of two thin factors). Models are increasingly trained or fine-tuned so that they compress well, for instance by pushing their weights toward low rank. These methods are mostly judged on factorization alone, yet a factorized model is also quantized before it is deployed. Does preparing a model for low rank help or hurt once it is also quantized, and can the combination compete with quantization alone? Our first measurements suggest the answer is less simple than it looks. Our group develops compression methods that measure errors by their effect on the network's outputs, and that predict in closed form what rounding low-rank factors costs.
6 mois
As an intern at the CEA, you will have the opportunity to work in a world-renowned research environment. Our teams consist of passionate and dedicated experts, providing an environment conducive to learning and collaboration. You will have access to state-of-the-art equipment and top-tier research resources to carry out your assignments. The work performed may potentially lead to a scientific publication.
This internship aims to understand how training a network toward low rank changes what it costs to quantize its factors, using the team's closed-form price of rounding both to explain the effect and to act on it. It combines matrix analysis with controlled experiments on language models, to:
What do we expect from you?
The internship may lead to a PhD starting in October 2027.
#Cea List
Pyyhon - PyTorch
Conformément aux engagements pris par le CEA en faveur de l'intégration des personnes handicapées, cet emploi est ouvert à toutes et à tous. Le CEA propose des aménagements et/ou des possibilités d'organisation pour l'inclusion des travailleurs handicapés.
Saclay
France, Ile-de-France, Essonne (91)
Saclay
Anglais (Intermédiaire)
Bac+5 - Diplôme École d'ingénieurs
Master 2 ou équivalent
Oui
01/02/2027
The CEA is the French Alternative Energies and Atomic Energy Commission ("Commissariat à l'énergie atomique et aux énergies alternatives"). It is a public body established in October 1945 by General de Gaulle. A leader in research, development and innovation, the CEA mission statement has two main objectives: To become the leading technological research organization in Europe and to ensure that the nuclear deterrent remains effective in the future.
The CEA is active in four main areas: low-carbon energies, defense and security, information technologies and health technologies. In each of these fields, the CEA maintains a cross-disciplinary culture of engineers and researchers, building on the synergies between fundamental and technological research.
The civilian programs of the CEA received 49% of their funding from the French government, and 30% from external sources (partner companies and the European Union).
The CEA had a budget of 4,3 billion euros.
The CEA is based in ten research centers in France, each specializing in specific fields. The laboratories are located in the Paris region, the Rhône-Alpes, the Rhône valley, the Provence-Alpes-Côte d'Azur region, Aquitaine, Central France and Burgundy. The CEA benefits from the strong regional identities of these laboratories and the partnerships forged with other research centers, local authorities and universities.
