Offensive Content Mitigation Research

Il y a 2 mois


Grenoble, France NAVER LABS Europe Temps plein

Modern LLMs have acquired impressive language understanding while being trained on a massive amount of data but they may struggle to generate responses that align with user preferences and expectations for the input request. In deployment systems, a crucial task is to ensure that the generated content is free of offensive expressions and patronizing language to address the safety risks posed by deployed systems, such as chatbots and conversational agents. While a lot of effort is invested into alignment of LLMs [1,2,3,4,5], the safety risk is still existent, especially for non-English content [6,7,8,9]. Moreover, many aligned models tend to overreact to certain “trigger patterns” (eg. swear words, mention of protected attributes, etc.) and may wrongly refuse to answer inoffensive questions, which results in existing tension between “helpfulness” and “safety”. Models’ over-reliance on such patterns makes detection of implicit hate speech more challenging [11,14].
The goal of this internship is to investigate strategies to diminish offensive content generation focusing on implicit offensive speech in multilingual settings.
**Supervisors**: Caroline Brun and Vassilina Nikoulina
Required skills
- PhD or last year MSc student in NLP-related domains
- Solid deep learning and NLP background
- Strong programming skills, with knowledge of PyTorch, NumPy, and the HF Transformers
- Familiarity with recent preference optimization techniques, such as DPO, is a plus
- Ability to communicate in English; knowledge of French is an advantage

References
[1] Compositional Preference Models for Aligning LMs. D.Go et al. ICLR 2024
**[2] Back to Basics**: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs Ahmadian et al. 2024
**[3] Camels in a Changing Climate**: Enhancing LM Adaptation with Tulu 2. Ivison et al. 2023
**[4] Direct Preference Optimization**: Your Language Model is Secretly a Reward Model. Rafailov et al 2023
[6] Li, Xiaochen, Zheng-Xin Yong, and Stephen H. Bach. "Preference tuning for toxicity mitigation generalizes across languages." arXiv preprint arXiv: 2406.16235 (2024).
**[9] FrenchToxicityPrompts**: a Large Benchmark for Evaluating and Mitigating Toxicity in French Texts. Brun and Nikoulina 2024
**[10] Playing the Part of the Sharp Bully**: Generating Adversarial Examples for Implicit Hate Speech Detection:
[11] Ocampo, Nicolas Benjamin, et al. "An in-depth analysis of implicit and subtle hate speech messages." Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 2023.
Application instructions
Please note that applicants must be registered students at a university or other academic institution and that this establishment will need to sign an 'Internship Convention' with NAVER LABS Europe before the student is accepted.
About NAVER LABS
NAVER is the #1 Internet portal in Korea with activities that span a wide range of businesses including search, commerce, content, financial and cloud platforms.
NAVER LABS, co-located in Korea and France, is the organization dedicated to preparing NAVER’s future. NAVER LABS Europe is located in a spectacular setting in Grenoble, in the heart of the French Alps. Scientists at NAVER LABS Europe are empowered to pursue long-term research problems that, if successful, can have significant impact and transform NAVER. We take our ideas as far as research can to create the best technology of its kind. Active participation in the academic community and collaborations with world-class public research groups are, among others, important tools to achieve these goals. Teamwork, focus and persistence are important values for us.
NAVER LABS Europe is an equal opportunity employer.



  • Grenoble, France NAVER LABS Europe Temps plein

    We are looking for a researcher to foster our work on LLMs and Retrieval including Retrieval Augmented Generation (RAG). More generally, our team is interested in studying in depth the connection between search, LLMs and agents. This position is open to both junior and senior researchers. Application instructions About NAVER LABS NAVER is the #1 Internet...


  • Grenoble, France NAVER LABS Europe Temps plein

    The Optimization with Learning team is hiring a full-time researcher. Applications from research scientists at any level or career stage are welcome. The team works closely with other groups at Naver Labs, including robotics teams at Naver Labs Korea. We also publish some of our research in machine learning and AI conferences. Recent publications include:...


  • Grenoble, France NAVER LABS Europe Temps plein

    **What we do**: **What we expect (depending on your career stage)**: - A PhD in computer science, electrical engineering, or a related field, with a focus on HPC, neural networks, or 3D vision. - Deep understanding and substantial experience in high-performance computing (HPC) and multi-node compute strategies. - Expertise in neural network architecture,...


  • Grenoble, France NAVER LABS Europe Temps plein

    We are looking for a research scientist to join the Visual Representation Learning (VRL) team at NAVER LABS Europe. **What we do**: The visual representation learning team works toward developing versatile representations which could improve the visual perception modules of robots, self-driving vehicules and other autonomous platforms. Our research also...


  • Grenoble, France NAVER LABS Europe Temps plein

    The 3D HUMANS team at NAVER LABS Europe is recruiting a full-time researcher. Our team focuses on human-centric computer vision, encompassing topics such as 3D human pose estimation, 3D human mesh recovery, human pose/motion generation and forecasting, action recognition, and hand-object interactions. Recent contributions from our team include multi-HMR...


  • Grenoble, France NAVER LABS Europe Temps plein

    **What we do**: The Robot Learning team aims at endowing mobile manipulators with generic learning systems to make them able to perform diverse complex physical tasks in a safe, robust and versatile manner. Our learning systems are based on multimodal foundation models, allowing multi-level sequential reasoning, continual self-improvement and incorporation...


  • Grenoble, France NAVER LABS Europe Temps plein

    has experience in navigation (ideally with social navigation), is familiar with ROS (preferably ROS2) and its navigation stack, is familiar with the state of the art on path planning algorithms, is comfortable with writing maintainable Python code, and has an open mind and is able to communicate and work collaboratively within a multidisciplinary research...


  • Grenoble, France NAVER LABS Europe Temps plein

    Wouldn't it be great if conversational agents were truly trustworthy? LLM-powered conversational agents excel at various roles and tasks.. However, they can be brittle and lack robustness when used in real-world scenarios, where requests can be inappropriate, beyond the assistant's mission, or simply ambiguous. If you agree it’s a key prerequisite for...

  • Multimodal Llms

    Il y a 6 mois


    Grenoble, France NAVER LABS Europe Temps plein

    Multimodality, in particular the incorporation of speech representations into LLMs, enables systems to comprehend and respond to spoken language with unparalleled accuracy and depth. Different methods for fusion have been explored recently, ranging from shallow fusion through discrete speech units modeling [1,2] to more complex approaches for integrating...

  • Bilingual Assistant

    il y a 2 jours


    Grenoble, France ILL Temps plein

    **Bilingual Assistant (English/French)** **Context** The Institut Laue-Langevin (ILL), situated in Grenoble, France, is Europe's leading research facility for fundamental research using neutrons. Every year, the ILL hosts over 2000 visits by scientists, who come to carry out world-class research. Are you interested in taking up a new challenge in our...


  • Grenoble, France NAVER LABS Europe Temps plein

    We are looking for students who are interested in working on retrieval augmented generation (RAG). Based on a simple idea of augmenting user requests with relevant passages retrieved from the Internet or a given collection, RAG has recently emerged as a promising solution for incorporating recent or domain-specific knowledge into LLMs and improving LLM...


  • Grenoble, France Xenics Temps plein

    We are expanding our Infrared & CMOS Image Sensor Design Team in Grenoble, France! Do you love designing and developing groundbreaking ideas for the next generation of Advanced Camera & Imaging systems? Do you have at least 5 years of relevant experience? This job opening is for you! You’ll collaborate with teams across the world (USA, Canada, Europe) to...

  • Ui/ux Designer

    Il y a 6 mois


    Grenoble, France NAVER LABS Europe Temps plein

    We are seeking a highly motivated UI/UX Designer Intern to join our team. This role will be focused on improving the usability and user experience of our robotic service management system, FLOW, designed to be used by non-technical users through a low code/no code approach. FLOW is an innovative environment designed for the intuitive creation and management...


  • Grenoble, France Photonis Infrared France Temps plein

    **Exosens, former Photonis group**, is a high-tech company with over 85 years of experience in the development, manufacturing and sales of detection and imaging technologies. We provide innovative imaging and detection solutions to enable technological breakthroughs for a safer world. Exosens is growing fast, and we are expanding our Infrared & CMOS Image...


  • Grenoble, France Quobly Temps plein

    Quobly aims to have a strong impact on society by providing cost-effective universal quantum processors to solve currently unsolvable problems. Founded in 2022, Quobly is a fast-growing start-up located in Grenoble's vibrant and multidisciplinary ecosystem. The company relies on the CNRS Neel Institute and CEA-Leti and benefits from the dynamic of strong...


  • Grenoble, France Photonis Infrared France Temps plein

    **Exosens, former Photonis group**, is a high-tech company with over 85 years of experience in the development, manufacturing and sales of detection and imaging technologies. We provide innovative imaging and detection solutions to enable technological breakthroughs for a safer world. We are expanding our Infrared & CMOS Image Sensor Design Team in...

  • Gsi Strategy

    il y a 6 heures


    Grenoble, France Hewlett Packard Temps plein

    **Who we are?** HP creates new possibilities for technology to have a meaningful impact on people, businesses, governments and society. The world’s largest technology company and one of the Fortune 100 Best Companies to Work For list in 2024, HP brings together a portfolio that spans printing, personal computing, software, services and IT infrastructure...


  • Grenoble, France ILL Temps plein

    **Apprentice - Junior Officer for Recruitment and HR Projects** **Core Mission** Do you dream of working in a dynamic and supportive team? Then look no further - we have the perfect apprenticeship position for you! Come and join our (5-person) Recruitment and Integration group, responsible for the recruitment and onboarding of new staff in an international...


  • Grenoble, France ILL Temps plein

    **Core mission** Do you dream of working in a dynamic and supportive team? Then look no further - we have the perfect apprenticeship position for you! Come and join our (5-person) Recruitment and Integration group, responsible for the recruitment and onboarding of new staff in an international environment. You will have the opportunity to work on innovative...

  • Emea Service Quality Leader

    il y a 4 semaines


    Grenoble, France Renewable Energy Hydro Temps plein

    **Job Description Summary**: GE Vernova is a planned, purpose-built global energy company that includes Power, Wind, and Electrification segments and is supported by its accelerator businesses of Advanced Research, Consulting Services, and Financial Services. Building on over 130 years of experience tackling the world’s challenges, GE Vernova is uniquely...