Internship: Advanced Constraint Processing in Large Language Models
il y a 2 jours
We’re looking for a Computer Science/Deep Learning PhD student or an outstanding Masters student, for a 5-6 month research internship starting early 2025. The internship will be hosted at NAVER LABS Europe, near Grenoble, France, where you will be integrated in the NLP team.
For examples of papers first-authored by former interns around the general topic of controlled generation, please have a look at the references [1-6] provided below.
Required skills
- Computer Science / Deep Learning PhD student or an outstanding Master student
- Proficiency with Large Language Models (LLMs) is required, including their training and fine-tuning.
- Being comfortable with the mathematical foundations of these models is a plus.
- Familiarity with PyTorch and alignment techniques (e.g., RLHF) is essential.
- You should feel at ease conducting experiments autonomously.
References
[1] Khalifa et al. A Distributional Approach to Controlled Text Generation. ICLR, 2021
[2] Eikema et al. An Approximate Sampler for Energy-Based Models with Divergence Diagnostics. TMLR, 2022
[3] Korbak et al. Controlling Conditional Language Models without Catastrophic Forgetting. ICML, 2022
[4] Korbak et al. On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with No Catastrophic Forgetting. NeurIPS, 2022
[5] Go et al. Aligning Language Models with Preferences through f-Divergence Minimization. ICML, 2023
[6] Kim et al. Guaranteed Generation from Large Language Models. arXiv, 2024
**[7] Kruszewski et al. disco**: A Toolkit for Distributional Control of Generative Models. ACL, 2023
Application instructions
About NAVER LABS
NAVER is the #1 Internet portal in Korea with activities that span a wide range of businesses including search, commerce, content, financial and cloud platforms.
NAVER LABS, co-located in Korea and France, is the organization dedicated to preparing NAVER’s future. NAVER LABS Europe is located in a spectacular setting in Grenoble, in the heart of the French Alps. Scientists at NAVER LABS Europe are empowered to pursue long-term research problems that, if successful, can have significant impact and transform NAVER. We take our ideas as far as research can to create the best technology of its kind. Active participation in the academic community and collaborations with world-class public research groups are, among others, important tools to achieve these goals. Teamwork, focus and persistence are important values for us.
NAVER LABS Europe is an equal opportunity employer.
-
Internship On Multimodal Large Language Models
il y a 2 jours
Meylan, France NAVER LABS Europe Temps pleinMultimodality, in particular the incorporation of speech representations into LLMs, enables systems to comprehend and respond to spoken language with unparalleled accuracy and depth. Different methods for fusion have been explored recently, ranging from shallow fusion through discrete speech units modeling [1,2] to more complex approaches for integrating...
-
Internship: Person-Centric Multimodal Large Language Model F/M
il y a 2 semaines
Meylan, Auvergne-Rhône-Alpes, France NAVER LABS Europe Temps pleinAbout NAVER LABS EuropeNAVER LABS Europe is part of the R&D division of NAVER, Korea's leading Internet portal and a global tech company with a range of services that include search, commerce, content, fintech, robotics and cloud.The position Multimodal Large Language Models (MLLMs) [1,2] have recently made substantial progress in linking visual and...
-
Meylan, France Orange Temps pleinVotre rôle est d'effectuer un travail de Post doc sur : " Architecture Description Language et modèle runtime pour le Continuum Cloud2IoT " qui contribuera au projet collaboratif " 5GMetaverse4Industry " financé par la BPI. Contexte global et problématique Orange et INRIA collaborent au travers d'un laboratoire commun et d'une équipe commune sur la...
-
Lead AE in Digital and STA
il y a 2 semaines
Meylan, Auvergne-Rhône-Alpes, France Cadence Temps pleinAt Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.We are looking for anApplication Engineer in Timing Analysis, located in GrenobleJob Description, Role And Key ResponsibilitiesThis is an excellent opportunity to work on challenging and complex SoC projects at advanced technology nodes withleading...
-
Research Scientist in Visual Representation Learning F/M
il y a 4 jours
Meylan, Auvergne-Rhône-Alpes, France NAVER LABS Europe Temps pleinAbout NAVER LABS Europe NAVER LABS Europe is part of the R&D division of NAVER, Korea's leading Internet portal and a global tech company with a range of services that include search, commerce, content, fintech, robotics and cloud. The positionWe are looking for a research scientist to join the Visual Representation Learning (VRL) team at NAVER LABS...
-
Meylan, Auvergne-Rhône-Alpes, France NAVER LABS Europe Temps pleinAbout NAVER LABS Europe NAVER LABS Europe is part of the R&D division of NAVER, Korea's leading Internet portal and a global tech company with a range of services that include search, commerce, content, fintech, robotics and cloud. The positionWe're looking for a highly experienced and exceptionally talented senior scientist in machine learning and...
-
Analog Designer
il y a 11 heures
Meylan, France Dolphin Design Temps plein**Join Dolphin Design, an innovative SME specializing in energy efficiency. **We are looking for an **Analog Designer (W/M**)** to strengthen our audio team in Meylan (38).** With 30 years of experience as pioneers in the audio sector, our quest for innovation never stops.** We are excited to embark you on our next project: an ultra-low power,...
-
Technical Lead
il y a 2 semaines
Meylan, Auvergne-Rhône-Alpes, France Dolphin Semiconductor Temps pleinDolphin Semiconductor has unique expertise in optimizing energy efficiency.Our customers target the consumer electronics markets, including IoT, multimedia, and automotive. We help them unleash their creativity to make their products more competitive while being more responsible in their energy consumption.You will take on the role of Technical Lead (digital...
-
Senior Digital Designer
il y a 2 jours
Meylan, France Dolphin Design Temps plein**Paul's Digital Design team is looking for a Senior Digital Designer Audio !** To support the growth of its **Audio & Metering** team and to meet the ever-increasing challenges of its customers regarding the density, power consumption and operating frequency of their integrated circuits, Dolphin Design is looking for a **Senior Digital Designer (F/M) based...
-
HR Administrative Officer – Experienced Level
il y a 4 semaines
Meylan, France Kayentis Temps pleinKAYENTIS is a software solutions provider specialized in clinical trials.Our core competence is in patient data capture and processing solutions (eClinical Outcome Assessments = eCOA) and we are now expanding towards Decentralized Trials functionalities.With 16 years of global experience in eCOA, Kayentis has supported more than 260 clinical trials in 79...
