Thesis a Generic and Model-agnostic Evaluation
il y a 2 semaines
Orange has implemented various bot solutions, and records large amounts of human-machine and human-to-human conversations for customer care. Often, these conversations are not rigorously evaluated.
Large language models (LLMs) are a breakthrough in many natural language processing (NLP) tasks, including the development of agents capable of solving complex tasks [6]. Moreover, developing chatbots has become democratized. It is likely that there will be a proliferation of solutions in the near future. The boundaries between various NLP tasks and the domains (e.g. tourism, restaurant, retail, technical support, etc.) are blurring.
The evaluation of the various solutions is becoming a real need, it is necessary to broaden the scope of evaluation and to make it transposable.
Inspired by the game theory [7], interpretability [2] and self-driving cars [8], we will infer the strategy that has been followed by the dialogue system [10]. We will work both on public (WebShop, ALFWorld,...) and private Orange (Technical Assistance, Commercial Bots, etc.) datasets.
References:
[1] Rojas-Barahona Lina M. (2020). Is the User Enjoying the Conversation? A Case Study on the Impact on the Reward Function. In proceedings of NeurIPS workshop HLDS2020.
[2] Michele Cafagna, Lina M. Rojas-Barahona, Kees van Deemter, Albert Gatt. Interpreting Vision and Language generative models with semantic visual priors. in Frontiers in AI. Special issue : Explainable AI in Natural Language.
[3] Marilyn A. Walker, Diane J. Litman, Candace A. Kamm, and Alicia Abella. 1997a. PARADISE: A framework for evaluating spoken dialogue agents. ACL and EACL, pages 271-280, Madrid, Spain.
[4] Ultes, Stefan, and Wolfgang Maier. "Similarity scoring for dialogue behaviour comparison." SIGDIAL. 2020.
[5] Mehri, Shikib, et al. "Interactive evaluation of dialog track at DSTC9." arXiv preprint arXiv:2207.14403 (2022).
[6] Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022. React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629 [7] Yu, Xiaopeng, et al. "Model-based opponent modeling." Advances in Neural Information Processing Systems 35 (2022): 28208-28221.
[8] Teng, Siyu, et al. "Motion planning for autonomous driving: The state of the art and future perspectives." IEEE Transactions on Intelligent Vehicles (2023).
**about you**:
- You have experience in the fields of Artificial Intelligence, Machine Learning and particularly in deep learning.
- You have a good level of mathematics (numerical optimization, statistics, probability, etc.).
- You are proficient in software development
- You are proficient in read, written and spoken English
- You are curious, attracted by new technologies, and ready to keep up with their evolutions
- You enjoy working in a team, within multidisciplinary projects, and contributing to a common goal, while being autonomous in your activities
- You have good analytical and synthesis skills
- Proficiency in one of the following deep learning tools: Torch, pyTorch, TensorFlow, MXNet would be a plus
- You like to communicate the results of your work through written reports and oral presentations preferable in English
Required training (master's degree, engineering degree, PhD, scientific and technical field, etc.)
Engineering degree and/or Research Master's degree, with knowledge in machine learning and in at least one of the fields listed above.
Desired experience (internships, etc.)
A first experience in the implementation of deep learning algorithms (as part of an internship for example) would be a plus.
**additional information**:
You will join a team specialized in dialogue, you will work with researchers, data scientists, architects, developers, PhD students and interns.
**department**:
Orange Innovation brings together the research and innovation activities and expertise of the Group's entities and countries. We work every day to ensure that Orange is recognized as an innovative operator by its customers, and we create value for the Group and the Brand in each of our projects. With 720 researchers, thousands of marketers, developers, designers and data analysts, it is the expertise of our 6,000 employees that fuels this ambition every day.
Orange Innovation anticipates technological breakthroughs and supports the Group's countries and entities in making the best technological choices to meet the needs of our consumer and business customers.
Big Data and Artificial Intelligence is an important lever for Orange. Therefore, it is possible to re-create the customer relationship optimizing the network management, enhancing the customer experience producing a great advantage from the customer perspective.
Orange is developing products and services based on artificial intelligence that use natural language processing, dialogue and conversational agents, pattern recognition and predictive analytics technologies.
The Data & AI department's main mission i
-
Lannion, France Orange Business Services Temps pleinabout the role Your role is to conduct doctoral research to simulate scenarios for sustainability in the telecommunications sector using artificial intelligence and a digital twin. The telecommunications sector has a significant impact on planetary boundaries, both in terms of energy and the environment. The current state of the art...
-
Lannion, France Orange Business Services Temps pleinabout the role Your role is to carry out a thesis work on “Control plane and routing in quantum telecommunications networks by entanglement”. More precisely, the thesis focuses on the development of a control plane for quantum communications networks by entanglement, thus aiming to increase the size of these networks. Currently, research in this...
-
Phd Thesis: Programmable Wireless Radio for
il y a 4 semaines
Lannion, France IRISA Temps plein**PhD thesis: Programmable wireless radio for long-life communications**: - Réf **ABG-121706** - Sujet de Thèse- 22/03/2024- Financement public/privé- IRISA- Lieu de travail- Lannion - Bretagne - France- Intitulé du sujet- PhD thesis: Programmable wireless radio for long-life communications- Champs scientifiques- Télécommunications - Mots clés-...
-
Phd societal, Environmental and Economic Impacts of
il y a 4 semaines
Lannion, France Orange Temps plein**About the role**: Your role is to carry out a PhD on the: "Societal, environmental and economic impacts of digital infrastructures". The digital transition impacts all economic sectors and in particular network operators, with the technical fragmentation of networks, the fragmentation of network players, and the future generation of networks. In the...
-
Software automation and Modeling engineer
il y a 5 heures
Lannion, France Ekinops Temps pleinDuration: 6 months Looking for an exciting internship in a fast-growing high-tech company, inside an international team? Job Context For over 20 years, Ekinops has been driving innovation in network systems. We provide solutions focused on the needs of communication service providers and enterprises worldwide. We provide open , trusted and ...
-
Apprenticeship Software Development Data Management
il y a 1 mois
Lannion, France NOKIA Temps pleinThe NOKIA LANNION site is a technology centre mainly focused today on radio access (4G & 5G), core network services and cyber security. Description You will be part of a team with varied skills (development, testing, integration, architecture) whose DNA is creativity and innovation. You will participate in the development of Telecom functionalities in...
-
Grc Sme
il y a 1 mois
Lannion, France NOKIA Temps pleinAbout Cloud & Network Services Cloud and Network Services is a leading Nokia business group that offers Network solutions on Core, Business and Enterprise segments, as well as Cloud solutions and Cognitive Services. It is a newly formed business group, that includes most of the former Nokia Software business, Nokia’s enterprise solutions, core network...
-
SOC Modelling Engineer
il y a 1 mois
Lannion, France NOKIA Temps plein**Come create the technology that helps the world act together** Nokia is committed to innovation and technology leadership across mobile, fixed and cloud networks. Your career here will have a positive impact on people’s lives and will help us build the capabilities needed for a more productive, sustainable, and inclusive world. We challenge ourselves...
-
Senior SOC Verification Engineer
il y a 1 mois
Lannion, France NOKIA Temps plein**Come create the technology that helps the world act together** Nokia is committed to innovation and technology leadership across mobile, fixed and cloud networks. Your career here will have a positive impact on people’s lives and will help us build the capabilities needed for a more productive, sustainable, and inclusive world. We challenge ourselves...
-
Pf - Ssi Engineer
il y a 1 mois
Lannion, France Apizee Temps pleinApizee is looking for a PF - SSI Engineer. Join us! **Company overview**: Apizee, a 100% French video communication solution for connecting customers via videoconferencing, provides remote support and expertise for equipment, traditional videoconferencing, or teleconsultation. Since 2020 Apizee has been part of the Bouygues Telecom group, which makes it...
-
Internship Security Risk Analysis for 5g Networks
il y a 4 semaines
Lannion, France NOKIA Temps pleinOur team Lannion site is a global technology center mainly focused on Radio Access (5G with, L1 & L3), Core Services and Cyber Security. You want to participate in the creation of a European Cyber Security Centre for telecom networks at our Nokia site in LANNION (with highly skilled experts to develop, sell and deliver cyber security services for 5G and...
-
Apprenticeship/internship Security Engineer for 5g
il y a 4 semaines
Lannion, France NOKIA Temps plein**Our team** Lannion site is a global technology center mainly focused on Radio Access (5G with, L1 & L3), Core Services and Cyber Security. You want to participate in the creation of a European Cyber Security Centre for telecom networks at our Nokia site in LANNION (with highly skilled experts to develop, sell and deliver cyber security services for 5G...
-
Euc L1 Technical Support
il y a 1 mois
Lannion, France DeRisk Technologies Temps pleinDesktop Technician will provide day to day local Position Responsibilities and Functions: a) Provide first/second level contact and problem resolution for customer issues. b) Work with Third Party Vendors to remediate complex AV issues as needed. c) Provide timely communication on issue status and resolution. d) Maintain ticket updates for all reported...
-
Digital Product Owner
il y a 1 mois
Lannion, France Ericsson Temps plein**About this opportunity!**: The Product Owner (PO) is a member of the Agile Team responsible for defining Stories and prioritizing the Team Backlog to streamline the execution of ART priorities, that come from the Product Manager through the prioritization of the Product/ART Backlog, while maintaining the conceptual and technical integrity of the Features...
-
Embedded Software Engineer
il y a 4 heures
Lannion, France Ekinops Temps pleinTelework options: hybrid on site – remote Looking for an exciting and permanent job in a fast-growing high-tech company, offering a variety of assignments and interactions? Job Context For over 20 years, Ekinops has been driving innovation in network systems. We provide solutions focused on the needs of communication service providers and...
-
Chercheur en Intelligence Artificielle Appliquée
il y a 1 mois
Lannion, France Orange Temps plein**About the role**: Missions Au sein de l’équipe Deskiñ, vous menez des activités de recherche en traitement automatique du langage naturel, en utilisant plus particulièrement des techniques d’apprentissage profond. Certaines de ces activités peuvent cependant se situer à la frontière entre le TALN et l’ingénierie des connaissances: - analyse...
-
SOC Verification Lead, Top
il y a 1 mois
Lannion, France NOKIA Temps pleinDescriptif du poste - ** Venez créer la technologie qui aide le monde à agir ensemble** Nokia s'engage en faveur de l'innovation et du leadership technologique sur les réseaux mobiles, fixes et cloud. Votre carrière ici aura un impact positif sur la vie des gens et nous aidera à développer les capacités nécessaires pour un monde plus productif,...
-
Product Manager
il y a 4 semaines
Lannion, France Eco Compteur Temps plein**PRODUCT MANAGER F/H - CDI - LANNION** Chez Eco Compteur, le Product Manager c’est celle ou celui qui va établir la stratégie produit (fédérer les besoins, caractériser, formaliser) et la mettre en oeuvre sur tous les services impliqués (Cahier des charges, Roadmap, Suivi PLC),_ tel un chef d’orchestre._ **Tes rôles**: - Construire une vision...
-
Gestionnaire Copropriété
il y a 1 mois
Lannion, France Foncia Temps pleinFoncia, filiale du groupe Emeria, recrute ! Avec déjà + 500 agences et 11 000 salariés sur tout le territoire, notre développement se poursuit. Avec un chiffre d'affaires d'1,2 milliard d'euros en 2021, notre ambition est d'être l'acteur de référence des services immobiliers résidentiels, reconnu pour sa qualité de service et le développement de...
-
Approvisionneur (H/F)
il y a 1 mois
Lannion, France Spring Temps plein**Votre mission**: LHH Recruitment Solutions, cabinet de conseil en recrutement, intérim spécialisé, management de transition, et évaluation d'expert.e.s, cadres et dirigeant.e.s, recrute en intérim longue durée pour son client, un approvisionneur (H/F) Vos missions: Calculs de besoins en fonction de prévisionnels et du stock déjà disponible Achats...
