Internship: Advanced Constraint Processing in Large Language Models
il y a 4 jours
We’re looking for a Computer Science/Deep Learning PhD student or an outstanding Masters student, for a 5-6 month research internship starting early 2025. The internship will be hosted at NAVER LABS Europe, near Grenoble, France, where you will be integrated in the NLP team.
For examples of papers first-authored by former interns around the general topic of controlled generation, please have a look at the references [1-6] provided below.
Required skills
- Computer Science / Deep Learning PhD student or an outstanding Master student
- Proficiency with Large Language Models (LLMs) is required, including their training and fine-tuning.
- Being comfortable with the mathematical foundations of these models is a plus.
- Familiarity with PyTorch and alignment techniques (e.g., RLHF) is essential.
- You should feel at ease conducting experiments autonomously.
References
[1] Khalifa et al. A Distributional Approach to Controlled Text Generation. ICLR, 2021
[2] Eikema et al. An Approximate Sampler for Energy-Based Models with Divergence Diagnostics. TMLR, 2022
[3] Korbak et al. Controlling Conditional Language Models without Catastrophic Forgetting. ICML, 2022
[4] Korbak et al. On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with No Catastrophic Forgetting. NeurIPS, 2022
[5] Go et al. Aligning Language Models with Preferences through f-Divergence Minimization. ICML, 2023
[6] Kim et al. Guaranteed Generation from Large Language Models. arXiv, 2024
**[7] Kruszewski et al. disco**: A Toolkit for Distributional Control of Generative Models. ACL, 2023
Application instructions
About NAVER LABS
NAVER is the #1 Internet portal in Korea with activities that span a wide range of businesses including search, commerce, content, financial and cloud platforms.
NAVER LABS, co-located in Korea and France, is the organization dedicated to preparing NAVER’s future. NAVER LABS Europe is located in a spectacular setting in Grenoble, in the heart of the French Alps. Scientists at NAVER LABS Europe are empowered to pursue long-term research problems that, if successful, can have significant impact and transform NAVER. We take our ideas as far as research can to create the best technology of its kind. Active participation in the academic community and collaborations with world-class public research groups are, among others, important tools to achieve these goals. Teamwork, focus and persistence are important values for us.
NAVER LABS Europe is an equal opportunity employer.
-
Internship On Multimodal Large Language Models
il y a 4 jours
Meylan, France NAVER LABS Europe Temps pleinMultimodality, in particular the incorporation of speech representations into LLMs, enables systems to comprehend and respond to spoken language with unparalleled accuracy and depth. Different methods for fusion have been explored recently, ranging from shallow fusion through discrete speech units modeling [1,2] to more complex approaches for integrating...
-
Meylan, France Orange Temps pleinPostdoc Archi Description Language, modèle runtime pour Continuum Cloud2IoT Orange Meylan, Auvergne-Rhône-Alpes, France L'ambition de la Division Innovation est de porter plus loin l'innovation d'Orange et de renforcer son leadership technologique, en mobilisant nos capacités de recherche pour nourrir une innovation responsable au service de l'humain,...
-
Lead AE in Digital and STA
il y a 2 semaines
Meylan, France Cadence Temps pleinAt Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology. We are looking for an Application Engineer in Timing Analysis, located in Grenoble. Job Description, Role And Key Responsibilities This is an excellent opportunity to work on challenging and complex SoC projects at advanced technology nodes with...
-
Lead AE in Digital and STA
il y a 2 semaines
Meylan, France Cadence Design Systems Temps pleinAt Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology. We are looking for an Application Engineer in Timing Analysis, located in Grenoble Job Description, Role and Key Responsibilities This is an excellent opportunity to work on challenging and complex SoC projects at advanced technology nodes with...
-
Research Scientist in Visual Representation Learning F/M
il y a 2 semaines
Meylan, Auvergne-Rhône-Alpes, France NAVER LABS Europe Temps pleinAbout NAVER LABS Europe NAVER LABS Europe is part of the R&D division of NAVER, Korea's leading Internet portal and a global tech company with a range of services that include search, commerce, content, fintech, robotics and cloud. The positionWe are looking for a research scientist to join the Visual Representation Learning (VRL) team at NAVER LABS...
-
Senior Research Scientist – Machine Learning for Robotics F/M
il y a 2 semaines
Meylan, Auvergne-Rhône-Alpes, France NAVER LABS Europe Temps pleinAbout NAVER LABS Europe NAVER LABS Europe is part of the R&D division of NAVER, Korea's leading Internet portal and a global tech company with a range of services that include search, commerce, content, fintech, robotics and cloud. The positionWe're looking for a highly experienced and exceptionally talented senior scientist in machine learning and...
-
Senior Digital Designer
il y a 4 jours
Meylan, France Dolphin Design Temps plein**Paul's Digital Design team is looking for a Senior Digital Designer Audio !** To support the growth of its **Audio & Metering** team and to meet the ever-increasing challenges of its customers regarding the density, power consumption and operating frequency of their integrated circuits, Dolphin Design is looking for a **Senior Digital Designer (F/M) based...
-
Human-Robot Interaction Research Scientist F/M
il y a 2 semaines
Meylan, Auvergne-Rhône-Alpes, France NAVER LABS Europe Temps pleinAbout NAVER LABS Europe NAVER LABS Europe is part of the R&D division of NAVER, Korea's leading Internet portal and a global tech company with a range of services that include search, commerce, content, fintech, robotics and cloud. The positionThe Human-Robot Interaction (HRI) team is seeking a full-time researcher to contribute to the technical...
-
Digital Ic Verification Engineer
il y a 1 semaine
Meylan, France Dolphin Design Temps pleinTo support the growth of our ASIC business unit, we are seeking an **experienced digital verification engineer (M/F)**, based in Meylan (38). Your role will consist of technically managing the verification activities from the specification to the startup of the chip on projects in the defense, aeronautics, or aerospace fields. As the main point of contact in...
-
Technical Program Manager 6
il y a 1 semaine
Meylan, France Lam Research Temps plein**The Group You’ll Be A Part Of** The Global Customer Operations Group brings industry insights and experience to help our customers deliver on their technology roadmaps. We work tirelessly to earn the trust of our customers, because we know that working closely together leads to the highest quality outcomes. **The Impact You’ll Make** You are key...
