PhD Position F/M Responsible Reinforcement Learning: Robustness and Privacy in and by Sequential Decision Making

il y a 3 jours


Villeneuved'Ascq, France INRIA Temps plein

Contexte et atouts du poste

In his/her journey to the doctoral thesis, the candidate will be supported by PEPR project FOUNDRY, and supervised by . Debabrota and Emilie are affiliated with the 


As RL algorithms are getting deployed in real-life the questions of responsible deployment, such as robustness to noise and perturbation to the feedback from environment, and privacy if users are involved in the environment yielding data.

Our works have shown that for structure-less and linear settings of multi-armed bandits and active testing (aka pure exploration) imposing privacy yields two regimes of performance. For the regime used in practice, privacy can be preserved without loss of utility. But our existing approach is not directly applicable to more practically appealing settings of RL, like MDPs or bandits with side-information (aka contexts). In these settings, there is a gap between achievable performances and the algorithms. Thus, we want to study whether the cost of privacy in contextual bandits and MDPs, and also to design optimal, computationally efficient algorithms.

Similarly, we have studied impact of unbounded corruption in feedback and safety constraints in stochastic multi-armed bandits and active testing (aka pure exploration). We want to understand how do they impact more structured RL problems and how can we design optimal algorithms in these setting.

The project is expected to simulate the existing and new collaborations with researchers and groups working on privacy-preserving machine learning, robustness, adaptive testing, and reinforcement learning. In future, the candidate will be encouraged to not only work with us but collaborate internationally. The candidate will also be part of the

Mission confiée

This position is entirely dedicated to do one's Ph.D. thesis. French rules put a strong emphasis on the fact that the Ph.D. is completed within 3 full years of studies.

It is also possible to teach up to a reasonnable amount of time per year (say 30 hours / year to give a rough idea of what we mean by "reasonable"). More details about the topic of the Ph.D. is available at

Principales activités

All research activities, that is bibliographical search, proposing original ideas related to the topic of the Ph.D. and developing them, presenting the work in the Scool seminar, workshops and conferences. The candidate should aim to publish the research results in premier conferences and journals of our field of research (e.g. ICML, NeurIPS, COLT, IJCAI, AAAI, JMLR). Since the work involves and impacts the responsible AI in general, the successful candidate should collaborate in writing scientific articles aiming towards the larger audience.

Compétences

The candidate should preferably have the following skills:

A strong background in mathematics/statistics A good knowledge of machine learning, statistics, and algorithms Broad interest for differential privacy and robustenss Knowledge of programming languages such as Python. C/C++ Some experience with implementation and experimentation (a plus) A good command of English

Please follow the instructions given in to set up your application file.

In brief, the application of the candidate should include his/her CV, an application letter, (two or more) recommendation letters, and the school transcripts. It is reccommended that the candidate contacts Debabrota and Emilie while preparing the application.

The deadline for application is 15th July, 2024.

Avantages

Subsidized meals Partial reimbursement of public transport costs Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) Possibility of teleworking and flexible organization of working hours Professional equipment available (videoconferencing, loan of computer equipment, etc.) Social, cultural and sports events and activities Access to vocational training Social security coverage

Rémunération

1st and 2nd year : 2100 € (gross monthly salarye)

3rd year : 2190 € (gross monthly salary)



  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste In his/her journey of postdoc, the candidate will be supported by . Debabrota is affiliated with the  The candidate is expected to work on understanding impact of different types of constraints and structures on the performance and design of bandit and RL algorithms. The project is expected to simulate the existing and...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste The selected PhD candidate will be based in Lille in the Mission confiée Machine learning is nowadays used in various applications, such as medical diagnosis and speech recognition. Its success stems from the performance of learned models, sometimes reaching human-level capabilities. However, deploying these models...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste Multi-armed bandit theory has witnessed tremendous progress over the last decade, yielding algorithms achieving strong learning guarantees (regret minimization, best-arm identification) in increasingly challenging context involving sequential decision-making in uncertain environment. In particular, recent works obtained...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This postdoctoral position is part of the national PEPR (Programme et Equipement Prioritaire de Recherche) PlantAgroEco project, coordinated by Alexis Joly. The PEPR involves several teams from various institutes (Inria ZENITH, CIRAD AMAP, CIRAD PHIM, CIRAD PBVMT, INRAE ePhytia, INRAE IGEPP, INRAE LISAH, IRD EGCE, IRD...


  • Villeneuve-d'Ascq, Hauts-de-France INRIA Temps plein

    Contexte et atouts du poste This PhD student position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been an...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This PhD student position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This engineer position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has been an...

  • Temporary scientific engineer

    il y a 4 semaines


    Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This engineer position will be supported by the CAPS'UL project. The position will be based in the MAGNET team in Lille, in very close collaboration with the Lille Hospital. The CAPS'UL project objective is to promote digital health culture for current and future healthcare professionals. Part of the project concerns the...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste This post-doctoral position will be supported by the project. While this position will be in the MAGNET team in Lille, we will collaborate with the several European project partners. While AI techniques are becoming ever more powerful, there is a growing concern about potential risks and abuses. As a result, there has...

  • Learning Specialist

    il y a 2 semaines


    Villeneuve-d'Ascq, Hauts-de-France mccainfood Temps plein

    Position Title:Learning SpecialistPosition Type: Regular - Full-Time ​Requisition ID: 29392 If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you We are passionate about potatoes. But we're even more passionate about our PeopleMcCain knows the importance that food plays in...

  • Learning Specialist

    il y a 4 semaines


    Villeneuve-d'Ascq, France mccainfood Temps plein

       Position Title:Learning SpecialistPosition Type: Regular - Full-Time ​Requisition ID: 29392   If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you! We are passionate about potatoes. But we’re even more passionate about our People!McCain knows the importance that...


  • Villeneuve-d'Ascq, Hauts-de-France mccainfood Temps plein

    ​​ Position Title: Manager, Social and Labor RelationsPosition Type: Regular - Full-Time ​Position Location: VilleneuvedAscq 2020 Requisition ID: 28591 ​McCain knows the importance that food plays in people's lives – the power it has to bring people, families and communities together. That is why our purpose is celebrating real connections through...


  • Villeneuve-d'Ascq, France mccainfood Temps plein

       Position Title: Director Center of Excellence Commerce CE and MENA Position Type: Regular - Full-Time ​Position Location: VilleneuvedAscq 2020 Requisition ID: 29116   We are looking for our new Director Centre of Excellence Commerce CE (Continental Europe) & MENA (Middle East and North Africa) to join our commercial organization at...


  • Villeneuve-d'Ascq, France mccainfood Temps plein

    ​​  Position Title: Manager, Social and Labor RelationsPosition Type: Regular - Full-Time ​Position Location: VilleneuvedAscq 2020 Requisition ID: 28591   ​McCain knows the importance that food plays in people's lives – the power it has to bring people, families and communities together. That is why our purpose is celebrating real...


  • Villeneuve-d'Ascq, France McCain Foods Temps plein

    Position Title: Director Center of Excellence Commerce CE and MENA  Position Type: Regular - Full-Time ​ Position Location: VilleneuvedAscq 2020  Requisition ID:  29116  We are looking for our new Director Centre of Excellence Commerce CE (Continental Europe) & MENA (Middle East and North Africa) to join our commercial organization...

  • Learning Specialist

    il y a 4 semaines


    Villeneuve-d'Ascq, France McCain Foods Temps plein

    Position Title: Learning Specialist Position Type: Regular - Full-Time ​ Requisition ID:  29392  If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you! We are passionate about potatoes. But we’re even more passionate about our People! McCain knows the...

  • Learning Specialist

    il y a 2 semaines


    Villeneuve-d'Ascq, Hauts-de-France McCain Foods Temps plein

    Position Title: Learning Specialist Position Type: Regular - Full-Time ​ Requisition ID: 29392 If you are passionate about learning and development and thrive in a dynamic, results-oriented environment, we want to hear from you We are passionate about potatoes. But we're even more passionate about our People McCain knows the importance that...


  • Villeneuve-d'Ascq, France McCain Foods Temps plein

    ​​ Position Title: Manager, Social and Labor Relations Position Type: Regular - Full-Time ​ Position Location: VilleneuvedAscq 2020  Requisition ID:  28591  ​ McCain knows the importance that food plays in people's lives – the power it has to bring people, families and communities together. That is why our purpose is...


  • Villeneuve-d'Ascq, France INRIA Temps plein

    Contexte et atouts du poste Context This thesis is part of the French ANR project PEPR O2R (Flagship project named Organic Robotic, 37.5 Million Euros), more particularly the work-package “Softness and Sustainability” of the Structuring Action 1 (AS1) which questions the environmental impact of robotics and tries to find innovative solutions to...

  • Senior Insights Manager

    il y a 4 semaines


    Villeneuve-d'Ascq, France mccainfood Temps plein

       Position Title: Senior Insights Manager (Lead Appetizers and New Business) Position Type: Regular - Full-Time ​Position Location: VilleneuvedAscq 2020 Requisition ID: 29130   We are passionate about potatoes. But we’re even more passionate about our People!McCain knows the importance that food plays in people's lives – the power it has to...