Retrieval Augmented Generation

We are looking for students who are interested in working on retrieval augmented generation (RAG).

Based on a simple idea of augmenting user requests with relevant passages retrieved from the Internet or a given collection, RAG has recently emerged as a promising solution for incorporating recent or domain-specific knowledge into LLMs and improving LLM factuality.
Despite recent progress, focused e.g. on optimizing RAG configuration [1], filtering irrelevant context [2, 3], or adaptively deciding when to use retrieval [4, 5], RAG is still far from being a versatile and flexible technique ready to be used in any LLM scenario. The topic of the internship will be related to improving RAG applicability to multilingual and/or multi-domain settings.
You will work with a team of researchers with both Information Retrieval [6,7] and Language Generation [8,9] backgrounds.

**Supervisors**: Vassilina Nikoulina and Nadezhda Chirkova

Required skills
- PhD or last year MSc student in NLP-related domains
- Solid deep learning and NLP background
- Experience with Pytorch toolkit

References

**[1] RAGGED**: Towards Informed Design of Retrieval Augmented Generation Systems
[2] Learning to Filter Context for Retrieval-Augmented Generation
**[3] Chain-of-Note**: Enhancing Robustness in Retrieval-Augmented Language Models
[4] Active Retrieval Augmented Generation
**[5] Self-RAG**: Learning to Retrieve, Generate, and Critique through Self-Reflection
**[6] SPLADE**: Sparse Lexical and Expansion Model for First Stage Ranking
[8] Zero-shot cross-lingual transfer in instruction tuning of large language models
[9] Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks

Application instructions

Please note that applicants must be registered students at a university or other academic institution and that this establishment will need to sign an 'Internship Convention' with NAVER LABS Europe before the student is accepted.

About NAVER LABS

NAVER is the #1 Internet portal in Korea with activities that span a wide range of businesses including search, commerce, content, financial and cloud platforms.

NAVER LABS, co-located in Korea and France, is the organization dedicated to preparing NAVER’s future. NAVER LABS Europe is located in a spectacular setting in Grenoble, in the heart of the French Alps. Scientists at NAVER LABS Europe are empowered to pursue long-term research problems that, if successful, can have significant impact and transform NAVER. We take our ideas as far as research can to create the best technology of its kind. Active participation in the academic community and collaborations with world-class public research groups are, among others, important tools to achieve these goals. Teamwork, focus and persistence are important values for us.

NAVER LABS Europe is an equal opportunity employer.