Offensive Content Mitigation Research
Il y a 2 mois
Modern LLMs have acquired impressive language understanding while being trained on a massive amount of data but they may struggle to generate responses that align with user preferences and expectations for the input request. In deployment systems, a crucial task is to ensure that the generated content is free of offensive expressions and patronizing language to address the safety risks posed by deployed systems, such as chatbots and conversational agents. While a lot of effort is invested into alignment of LLMs [1,2,3,4,5], the safety risk is still existent, especially for non-English content [6,7,8,9]. Moreover, many aligned models tend to overreact to certain “trigger patterns” (eg. swear words, mention of protected attributes, etc.) and may wrongly refuse to answer inoffensive questions, which results in existing tension between “helpfulness” and “safety”. Models’ over-reliance on such patterns makes detection of implicit hate speech more challenging [11,14].
The goal of this internship is to investigate strategies to diminish offensive content generation focusing on implicit offensive speech in multilingual settings.
**Supervisors**: Caroline Brun and Vassilina Nikoulina
Required skills
- PhD or last year MSc student in NLP-related domains
- Solid deep learning and NLP background
- Strong programming skills, with knowledge of PyTorch, NumPy, and the HF Transformers
- Familiarity with recent preference optimization techniques, such as DPO, is a plus
- Ability to communicate in English; knowledge of French is an advantage
References
[1] Compositional Preference Models for Aligning LMs. D.Go et al. ICLR 2024
**[2] Back to Basics**: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs Ahmadian et al. 2024
**[3] Camels in a Changing Climate**: Enhancing LM Adaptation with Tulu 2. Ivison et al. 2023
**[4] Direct Preference Optimization**: Your Language Model is Secretly a Reward Model. Rafailov et al 2023
[6] Li, Xiaochen, Zheng-Xin Yong, and Stephen H. Bach. "Preference tuning for toxicity mitigation generalizes across languages." arXiv preprint arXiv: 2406.16235 (2024).
**[9] FrenchToxicityPrompts**: a Large Benchmark for Evaluating and Mitigating Toxicity in French Texts. Brun and Nikoulina 2024
**[10] Playing the Part of the Sharp Bully**: Generating Adversarial Examples for Implicit Hate Speech Detection:
[11] Ocampo, Nicolas Benjamin, et al. "An in-depth analysis of implicit and subtle hate speech messages." Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 2023.
Application instructions
Please note that applicants must be registered students at a university or other academic institution and that this establishment will need to sign an 'Internship Convention' with NAVER LABS Europe before the student is accepted.
About NAVER LABS
NAVER is the #1 Internet portal in Korea with activities that span a wide range of businesses including search, commerce, content, financial and cloud platforms.
NAVER LABS, co-located in Korea and France, is the organization dedicated to preparing NAVER’s future. NAVER LABS Europe is located in a spectacular setting in Grenoble, in the heart of the French Alps. Scientists at NAVER LABS Europe are empowered to pursue long-term research problems that, if successful, can have significant impact and transform NAVER. We take our ideas as far as research can to create the best technology of its kind. Active participation in the academic community and collaborations with world-class public research groups are, among others, important tools to achieve these goals. Teamwork, focus and persistence are important values for us.
NAVER LABS Europe is an equal opportunity employer.
-
Research Scientist in Llms and Retrieval
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps pleinWe are looking for a researcher to foster our work on LLMs and Retrieval including Retrieval Augmented Generation (RAG). More generally, our team is interested in studying in depth the connection between search, LLMs and agents. This position is open to both junior and senior researchers. Application instructions About NAVER LABS NAVER is the #1 Internet...
-
Research Scientist in Machine Learning and
Il y a 3 mois
Grenoble, France NAVER LABS Europe Temps pleinThe Optimization with Learning team is hiring a full-time researcher. Applications from research scientists at any level or career stage are welcome. The team works closely with other groups at Naver Labs, including robotics teams at Naver Labs Korea. We also publish some of our research in machine learning and AI conferences. Recent publications include:...
-
Research Scientist in 3D Vision
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps plein**What we do**: **What we expect (depending on your career stage)**: - A PhD in computer science, electrical engineering, or a related field, with a focus on HPC, neural networks, or 3D vision. - Deep understanding and substantial experience in high-performance computing (HPC) and multi-node compute strategies. - Expertise in neural network architecture,...
-
Research Scientist in Visual Representation Learning
Il y a 2 mois
Grenoble, France NAVER LABS Europe Temps pleinWe are looking for a research scientist to join the Visual Representation Learning (VRL) team at NAVER LABS Europe. **What we do**: The visual representation learning team works toward developing versatile representations which could improve the visual perception modules of robots, self-driving vehicules and other autonomous platforms. Our research also...
-
Research Scientist in Human-centric Computer Vision
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps pleinThe 3D HUMANS team at NAVER LABS Europe is recruiting a full-time researcher. Our team focuses on human-centric computer vision, encompassing topics such as 3D human pose estimation, 3D human mesh recovery, human pose/motion generation and forecasting, action recognition, and hand-object interactions. Recent contributions from our team include multi-HMR...
-
Machine Learning Research Scientist for Robotics
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps plein**What we do**: The Robot Learning team aims at endowing mobile manipulators with generic learning systems to make them able to perform diverse complex physical tasks in a safe, robust and versatile manner. Our learning systems are based on multimodal foundation models, allowing multi-level sequential reasoning, continual self-improvement and incorporation...
-
Social Robot Navigation for Shared Elevator
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps pleinhas experience in navigation (ideally with social navigation), is familiar with ROS (preferably ROS2) and its navigation stack, is familiar with the state of the art on path planning algorithms, is comfortable with writing maintainable Python code, and has an open mind and is able to communicate and work collaboratively within a multidisciplinary research...
-
Postdoc: Llm-powered Conversational Agents
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps pleinWouldn't it be great if conversational agents were truly trustworthy? LLM-powered conversational agents excel at various roles and tasks.. However, they can be brittle and lack robustness when used in real-world scenarios, where requests can be inappropriate, beyond the assistant's mission, or simply ambiguous. If you agree it’s a key prerequisite for...
-
Multimodal Llms
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps pleinMultimodality, in particular the incorporation of speech representations into LLMs, enables systems to comprehend and respond to spoken language with unparalleled accuracy and depth. Different methods for fusion have been explored recently, ranging from shallow fusion through discrete speech units modeling [1,2] to more complex approaches for integrating...
-
Bilingual Assistant
il y a 2 jours
Grenoble, France ILL Temps plein**Bilingual Assistant (English/French)** **Context** The Institut Laue-Langevin (ILL), situated in Grenoble, France, is Europe's leading research facility for fundamental research using neutrons. Every year, the ILL hosts over 2000 visits by scientists, who come to carry out world-class research. Are you interested in taking up a new challenge in our...
-
Retrieval Augmented Generation
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps pleinWe are looking for students who are interested in working on retrieval augmented generation (RAG). Based on a simple idea of augmenting user requests with relevant passages retrieved from the Internet or a given collection, RAG has recently emerged as a promising solution for incorporating recent or domain-specific knowledge into LLMs and improving LLM...
-
Experienced Analog and Mixed-signal Design Engineer
Il y a 6 mois
Grenoble, France Xenics Temps pleinWe are expanding our Infrared & CMOS Image Sensor Design Team in Grenoble, France! Do you love designing and developing groundbreaking ideas for the next generation of Advanced Camera & Imaging systems? Do you have at least 5 years of relevant experience? This job opening is for you! You’ll collaborate with teams across the world (USA, Canada, Europe) to...
-
Ui/ux Designer
Il y a 6 mois
Grenoble, France NAVER LABS Europe Temps pleinWe are seeking a highly motivated UI/UX Designer Intern to join our team. This role will be focused on improving the usability and user experience of our robotic service management system, FLOW, designed to be used by non-technical users through a low code/no code approach. FLOW is an innovative environment designed for the intuitive creation and management...
-
Analog and Mixed-signal Design Engineer
Il y a 6 mois
Grenoble, France Photonis Infrared France Temps plein**Exosens, former Photonis group**, is a high-tech company with over 85 years of experience in the development, manufacturing and sales of detection and imaging technologies. We provide innovative imaging and detection solutions to enable technological breakthroughs for a safer world. Exosens is growing fast, and we are expanding our Infrared & CMOS Image...
-
Backend and Database Software Developper
Il y a 6 mois
Grenoble, France Quobly Temps pleinQuobly aims to have a strong impact on society by providing cost-effective universal quantum processors to solve currently unsolvable problems. Founded in 2022, Quobly is a fast-growing start-up located in Grenoble's vibrant and multidisciplinary ecosystem. The company relies on the CNRS Neel Institute and CEA-Leti and benefits from the dynamic of strong...
-
Experienced Analog and Mixed-signal Design Engineer
Il y a 6 mois
Grenoble, France Photonis Infrared France Temps plein**Exosens, former Photonis group**, is a high-tech company with over 85 years of experience in the development, manufacturing and sales of detection and imaging technologies. We provide innovative imaging and detection solutions to enable technological breakthroughs for a safer world. We are expanding our Infrared & CMOS Image Sensor Design Team in...
-
Gsi Strategy
il y a 6 heures
Grenoble, France Hewlett Packard Temps plein**Who we are?** HP creates new possibilities for technology to have a meaningful impact on people, businesses, governments and society. The world’s largest technology company and one of the Fortune 100 Best Companies to Work For list in 2024, HP brings together a portfolio that spans printing, personal computing, software, services and IT infrastructure...
-
Apprentice - Junior Officer for Recruitment and HR
Il y a 6 mois
Grenoble, France ILL Temps plein**Apprentice - Junior Officer for Recruitment and HR Projects** **Core Mission** Do you dream of working in a dynamic and supportive team? Then look no further - we have the perfect apprenticeship position for you! Come and join our (5-person) Recruitment and Integration group, responsible for the recruitment and onboarding of new staff in an international...
-
Apprentice - Junior Officer for Recruitment and HR
Il y a 6 mois
Grenoble, France ILL Temps plein**Core mission** Do you dream of working in a dynamic and supportive team? Then look no further - we have the perfect apprenticeship position for you! Come and join our (5-person) Recruitment and Integration group, responsible for the recruitment and onboarding of new staff in an international environment. You will have the opportunity to work on innovative...
-
Emea Service Quality Leader
il y a 4 semaines
Grenoble, France Renewable Energy Hydro Temps plein**Job Description Summary**: GE Vernova is a planned, purpose-built global energy company that includes Power, Wind, and Electrification segments and is supported by its accelerator businesses of Advanced Research, Consulting Services, and Financial Services. Building on over 130 years of experience tackling the world’s challenges, GE Vernova is uniquely...