PhD Position F/M Ph.D. W/M: Robust approaches in sequential decision and learning problems.

il y a 1 mois


Villeneuved'Ascq, France INRIA Temps plein

Contexte et atouts du poste

Multi-armed bandit theory has witnessed tremendous progress over the last decade, yielding algorithms achieving
strong learning guarantees (regret minimization, best-arm identification) in increasingly challenging context involving sequential decision-making in uncertain environment. In particular, recent works obtained non-parametric
optimal algorithms, enabling application of multi-armed bandit to a large range of applications when reward distributions are not easily modelled with classical families.

Recently, a complementary bandit model considering Huber-outlier distributions (mixture between an parametric distribution of interest and an arbitrary one) has been studied, offering an interesting complementary perspective compared to non-parametric assumptions and modelling arbitrarily bad outlier observations, something often encountered in real applications.

This Ph.D. will focus on the problem of model misspecification in the context, i.e. we study the problem of sequential learning when some context, or feature, vector is available but we do not want to force strong assumptions on the context and assume only nonparametric or even corrupted model on the context. To summarize, we want to study both Regret minimization or Best-arm identification objectives, in the contextual setup assuming either Huber-outlier or Non-parametric distributions.

Mission confiée

The Ph.D. focuses on basic research, theory of multi-armed bandits, nonparametric and robust statistics, and for this reason the candidate will have to get familiar with both the litterature in multi-armed bandit and the litterature of nonparametric and robust statistics.

Principales activités

The suggested plan of this academic thesis consists in execution of three tasks or work packages, mainly oriented on development of fundamental approaches. Each will be accompanied by publications in international top-rated journals and conferences, in the spirit of open and reproducible science, open-source code, etc.

Task 1: Exploitation of uncertain or corrupted context in linear bandits.

When the context is corrupted or uncertain, exploiting the information given by the context is not obvious, and it may even be detrimental to consider a non-informative context as it makes the learning process more complicated. In this first task, we want to study the specific case of linear bandits that feature a simple link between context and reward and is a natural extension from univariate to multivariate in order to begin understanding uncertain contexts in the sequential setting. Complementary to the linear case, bandits with auxiliary information may also be a relevant structure to explore.


Task 2: Sequential optimality in corrupted environment.

To goal is to establish, in a corrupted environment, optimality of an algorithm. Even for the simple problem of estimating a univariate mean in corrupted environment, optimal strategy were discovered only very recently. We propose to extend recent works on optimal estimation in corrupted environment to the problem of sequential estimation in order to better understand the link between sequential setting and the loss of information via corruption. 


Task 3: Implementation of nonparametric and robust methods.

All the algorithms described previously should be implemented and tested, against state-of-the-art algorithms and perform well in practice. By testing on realistic environment (that are already developed by the host team) that have potentially a complex structure, we want to get practical evidence on the interplay between uncertain context and sequential learning to understand better the theoretical questions that should be asked in order to ascertain the efficiency of our algorithm when used in real applications. We are interested in particular in applications to agriculture because agriculture features very uncertain context and up to now the usual bandit strategies struggled to be efficient with such nonparametric problem.

Compétences

Skills required : Master level mathematic and statistics skills are required. In regard to computer skills, familiarity with Latex, Python and/or R are important.

Languages : English

Avantages

Subsidized meals Partial reimbursement of public transport costs Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) Possibility of teleworking and flexible organization of working hours Professional equipment available (videoconferencing, loan of computer equipment, etc.) Social, cultural and sports events and activities Access to vocational training Social security coverage

Rémunération

1st & 2nd year : 2100 € (grossly salary by month)

3rd year: 2190 € (grossly salary by month)



  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste The selected PhD candidate will be based in Lille in the Mission confiée Machine learning is nowadays used in various applications, such as medical diagnosis and speech recognition. Its success stems from the performance of learned models, sometimes reaching human-level capabilities. However, deploying these models...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste The selected PhD candidate will be based in Lille in the Mission confiée Machine learning is nowadays used in various applications, such as medical diagnosis and speech recognition. Its success stems from the performance of learned models, sometimes reaching human-level capabilities. However, deploying these models...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This postdoctoral position is part of the national PEPR (Programme et Equipement Prioritaire de Recherche) PlantAgroEco project, coordinated by Alexis Joly. The PEPR involves several teams from various institutes (Inria ZENITH, CIRAD AMAP, CIRAD PHIM, CIRAD PBVMT, INRAE ePhytia, INRAE IGEPP, INRAE LISAH, IRD EGCE, IRD...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This postdoctoral position is part of the national PEPR (Programme et Equipement Prioritaire de Recherche) PlantAgroEco project, coordinated by Alexis Joly. The PEPR involves several teams from various institutes (Inria ZENITH, CIRAD AMAP, CIRAD PHIM, CIRAD PBVMT, INRAE ePhytia, INRAE IGEPP, INRAE LISAH, IRD EGCE, IRD...


  • Villeneuve-d'Ascq, Hauts-de-France INRIA Temps plein

    Contexte et atouts du poste This PhD student position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been an...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This PhD student position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This PhD student position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste Every year Inria International Relations Department has a few postdoctoral positions  in order to support Inria international collaborations. The postdoctoral contract will have a duration of 12 to 24 months . The default start date is November 1st, 2024 and not later than January, 1st 2025 . The postdoctoral...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste Context This thesis is part of the French ANR project PEPR O2R (Flagship project named Organic Robotic, 37.5 Million Euros), more particularly the work-package “Softness and Sustainability” of the Structuring Action 1 (AS1) which questions the environmental impact of robotics and tries to find innovative solutions to...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste Context This thesis is part of the French ANR project PEPR O2R (Flagship project named Organic Robotic, 37.5 Million Euros), more particularly the work-package “Softness and Sustainability” of the Structuring Action 1 (AS1) which questions the environmental impact of robotics and tries to find innovative solutions to...

  • Learning Specialist

    il y a 1 semaine


    Villeneuve-d'Ascq, Hauts-de-France McCain Foods Temps plein

    Position Title: Learning Specialist Position Type: Regular - Full-Time ​ Requisition ID: 29392 If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you We are passionate about potatoes. But we're even more passionate about our People McCain knows the importance that...

  • Learning Specialist

    il y a 1 mois


    Villeneuve-d'Ascq, France McCain Foods Temps plein

    Position Title: Learning Specialist Position Type: Regular - Full-Time ​ Requisition ID:  29392  If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you! We are passionate about potatoes. But we’re even more passionate about our People! McCain knows the...

  • Learning Specialist

    il y a 4 semaines


    Villeneuve-d'Ascq, France McCain Foods Temps plein

    Position Title: Learning Specialist Position Type: Regular - Full-Time ​ Requisition ID:  29392  If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you! We are passionate about potatoes. But we’re even more passionate about our People! McCain knows the...

  • Learning Specialist

    il y a 1 mois


    Villeneuve-d'Ascq, France mccainfood Temps plein

       Position Title:Learning SpecialistPosition Type: Regular - Full-Time ​Requisition ID: 29392   If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you! We are passionate about potatoes. But we’re even more passionate about our People!McCain knows the importance that...

  • Learning Specialist

    il y a 1 semaine


    Villeneuve-d'Ascq, Hauts-de-France mccainfood Temps plein

    Position Title:Learning SpecialistPosition Type: Regular - Full-Time ​Requisition ID: 29392 If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you We are passionate about potatoes. But we're even more passionate about our PeopleMcCain knows the importance that food plays in...

  • Learning Specialist

    il y a 4 semaines


    Villeneuve-d'Ascq, France mccainfood Temps plein

       Position Title:Learning SpecialistPosition Type: Regular - Full-Time ​Requisition ID: 29392   If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you! We are passionate about potatoes. But we’re even more passionate about our People!McCain knows the importance that...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This engineer position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been an...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This engineer position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been an...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste A central issue in city logistics is to design systems that move goods to, from, and within urban areas while meeting sustainability goals. Such city logistics systems are generally based on new business models, cooperation among stakeholders, resource sharing, consolidation, synchronization of operations, multi and...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This post-doctoral position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has...