Privacy on-demand and Security preserving Federated Generative Networks or Models

il y a 3 semaines


Technopole de Sophia Antipolis, France INRIA Temps plein

Contexte et atouts du poste

Teams and supervision

• INRIA : COATI (Frédéric Giroire, Chuan Xu), EPIONE (Marco Lorenzi)

• NOKIA: Bell Labs Core Research

Mission confiée

Future sixth-generation (6G) networks will be highly heterogeneous, with the massive development of mobile edge computing inside networks. Furthermore, 6G is expected to support dynamic network environments and provide diversified intelligent services with stringent Quality of Service (QoS) re- quirements. Various new intelligent applications and services will emerge (including augmented reality (AR), wireless machine interaction, smart city, etc) and will enable tactile communications and In- ternet of everything (IoE). This will challenge wireless networks in the dimensions of delay, energy consumption, interaction, reliability, and degree of intelligence and knowledge, but also in the dimen- sion of information and data sharing. In turn, 6G networks will be expected about leveraging data at the next step of the new communication system generation. First of all, they will generate large amounts of data much more data than 5G networks: multiple sources as Core, Radio Access Network, OAM, User Equipments (UEs) but also as private and/or personal devices/machines massively con- nected, data-generator applications as sensing, localization, context-awareness services etc. Besides, unlike today’s networks where traffic is almost entirely centralized, most 6G traffic will remain localized and highly distributed. The communication system will not only provide the bits reliably, but more importantly will provide the intelligent data processing through connectivity and resources computing in the devices, the edge, and the cloud in the network. For this, with Artificial Intelligence (AI) and Machine Learning (ML), machines will bring to networks the necessary intelligence very close to the place of action and decision-making and will also make data sharing possible.

Reliable and efficient transmission, data privacy and security are great challenges in data sharing. Specially for 5G advanced and 6G networks data is distributed with the wide deployment of various connected Internet of Thing (IoT) devices, and are generated from many distributed network nodes, e.g., end users, small Base Stations or Distributed Units and the network edge. Also, how to col- lect/share efficiently data from multiple sources (e.g., sensors or device) up to AI/ML-based Network applications/services of Orchestration and Automation Layer (network management system) in Edge? The models shall be trained, updated regularly and operate in real-time.

Recently, generative models have been demonstrated playing a key role in data sharing while pre- serving privacy and security. They are able to generate synthetic data which distribution is similar to the original data one. So, instead of sending original data, many applications (medical or financial) use them to transfer data. Generative models are shown be useful in many scenarios such as health and financial applications [VSV+22]. However, the highly distributed architecture in 5G advanced/6G motivates the need for distributed, multi-agent learning for building generative models located at given anchor points of data collection (Edge server or Central Units) inside the RAN/Edge.

Challenges and objectives

We aim to design a communication-efficient and privacy-preserving on demand framework such that the local agents inside RAN/Edge cooperatively generate a synthetic dataset which represents well the global data distribution for model utility. To this end, one can train a generative adversarial network in a federated way [AMR+20], where the agents and the server alternatively minimize the loss function of the discriminator and the generator. However, deep generative models have a tendency to memorize the training examples which may leak private information [HMDC19, CYZF20]. While, applying the traditional privacy-preserving defense such as differential privacy mechanism [Dwo06] will degrade the generative model’s utility and thus influences the synthetic data quality. Moreover, the training requires 500-10000 communication rounds in practice for convergence (see [KMA+21, Table 2]) which is expensive for communication cost. Recently, there is another work [ZCL+22] where the server makes uses of all the local trained models to train a generator, which minimizes the communication cost to only one round. However, transferring these local models are extremely dangerous as they can be used to infer the private information on the dataset of devices [FJR15, YGFJ18]. Alternatively, instead of transferring the models as the previous work proposed, the devices can transfer directly the distilled synthetic data which are computed locally [ZPM+20]. However, the quality of the assembled synthetic dataset degrades especially when some agents have just few training samples.

We will first compare the above-mentioned existing methods for synthetic dataset generation, in terms of their trade-offs on model accuracy, data similarity, communication cost, model compression and privacy. Then, to expose their privacy vulnerability, we will design computational-efficient attacks, for both passive and active adversary cases. Finally, we will design a framework with better trade-off for the task.

The project is part of a larger collaborative project with Nokia Bell labs (Défi LearnNet). A PhD grant is funded as part of the global project as well as this internship. This internship can thus be followed by a PhD for a motivated student.

Principales activités

Research

Compétences

The candidate should have a solid mathematical background, good programming skills and previous experience with PyTorch or TensorFlow. He/She should also be knowledgeable on machine learning, especially generative neural networks, and have good analytical skills. We expect the candidate to be fluent in English.

Avantages

Subsidized meals Partial reimbursement of public transport costs Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) Possibility of teleworking (after 6 months of employment) and flexible organization of working hours Professional equipment available (videoconferencing, loan of computer equipment, etc.) Social, cultural and sports events and activities Access to vocational training Social security coverage

  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Bac + 5 ou équivalent**Fonction **:DoctorantA propos du centre ou de la direction fonctionnelle Le centre Inria d'Université Côte d'Azur regroupe 37 équipes de recherche et 8 services d’appui. Le personnel du centre (500 personnes environ) est...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Bac + 5 ou équivalent**Fonction **:DoctorantA propos du centre ou de la direction fonctionnelle Le centre Inria d'Université Côte d'Azur regroupe 37 équipes de recherche et 8 services d’appui. Le personnel du centre (500 personnes environ) est...

  • Phd Position F/m

    il y a 2 semaines


    Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **Niveau d'expérience souhaité **:Jeune diplômé **A propos du centre ou de la direction fonctionnelle**: The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Contrat renouvelable **:Oui **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The...


  • Sophia Antipolis, Provence-Alpes-Côte d'Azur, France Inria Temps plein

    Le descriptif de l'offre ci-dessous est en Anglais_Type de contrat :CDDContrat renouvelable :OuiNiveau de diplôme exigé :Thèse ou équivalentFonction :Post-DoctorantA propos du centre ou de la direction fonctionnelle:The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is...


  • Sophia Antipolis, France Université Côte d'Azur Temps plein

    **Apprentissage par Renforcement Fédéré // Federated Reinforcement Learning**: - Réf **ABG-122695** **ADUM-56518** - Sujet de Thèse- 11/04/2024- Université Côte d'Azur- Lieu de travail- Sophia Antipolis Cedex - France- Intitulé du sujet- Apprentissage par Renforcement Fédéré // Federated Reinforcement Learning- Mots clés- Apprentissage...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Thèse ou équivalent**Fonction **:Post-DoctorantA propos du centre ou de la direction fonctionnelle The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is made up of...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Thèse ou équivalent**Fonction **:Post-DoctorantA propos du centre ou de la direction fonctionnelle The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is made up of...


  • Sophia Antipolis, France Prove & Run Temps plein

    **System and Network Administrator**: **Company**: ProvenRun is a young, fast-growing company with 50 employees, most of them R&D engineers. We develop security software for embedded electronic devices in the aeronautics, automotive and telecommunications sectors. We have an R&D center in Sophia-Antipolis and another in Paris. We have just raised €15...


  • Sophia Antipolis, Provence-Alpes-Côte d'Azur, France Inria Temps plein

    Le descriptif de l'offre ci-dessous est en Anglais_Type de contrat :CDDNiveau de diplôme exigé :Thèse ou équivalentFonction :Post-DoctorantA propos du centre ou de la direction fonctionnelleThe Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is made up of scientists of...


  • Sophia Antipolis, France Mines Paris - PSL, Centre PERSEE Temps plein

    **Optimization of multi-actor energy systems enhanced with AI and privacy-preserving data sharing.**: - Réf **ABG-122602** - Sujet de Thèse- 10/04/2024- Autre financement privé- Mines Paris - PSL, Centre PERSEE- Lieu de travail- Sophia-Antipolis - Provence-Alpes-Côte d'Azur - France- Intitulé du sujet- Optimization of multi-actor energy systems...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is...


  • Hauts-de-Seine - 92, France Anderson RH Temps plein

    - Degree in engineering or Master's degree specialising in information systems security- Successful experience 8 years experience in the technologies sought- Experience in network and security- Good writing skills in English (C1)You will BE in charge of :Carrying out consultancy and expertise assignments, Gathering technical requirements and proposing a...


  • Hauts-de-Seine - 92, Ile-de-France Anderson RH Temps plein

    - Degree in engineering or Master's degree specialising in information systems security- Successful experience 8 years experience in the technologies sought- Experience in network and security- Good writing skills in English (C1)You will BE in charge of :Carrying out consultancy and expertise assignments, Gathering technical requirements and proposing a...

  • PhD Position F/M PhD

    il y a 4 semaines


    Technopole de Sophia Antipolis, France INRIA Temps plein

    Contexte et atouts du poste Within the framework of a partnership collaboration between 2 Inria teams: neo and coati and a company Nokia, Mission confiée With the current energy crisis, the skyrocketing cost of energy, and the global awareness of the consequences of carbon emissions on our planet, it is crucial to reduce the global...

  • PhD Position F/M PhD

    il y a 3 semaines


    Technopole de Sophia Antipolis, France INRIA Temps plein

    Contexte et atouts du poste Within the framework of a partnership collaboration between 2 Inria teams: neo and coati and a company Nokia, Mission confiée With the current energy crisis, the skyrocketing cost of energy, and the global awareness of the consequences of carbon emissions on our planet, it is crucial to reduce the global...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Université Côte d’Azur center counts 36 research teams as well as 7 support departments. The center's staff (about 500 people...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Université Côte d’Azur center counts 36 research teams as well as 7 support departments. The center's staff (about 500 people...

  • Stage de Master

    Il y a 2 mois


    Sophia Antipolis, France Université Côte d'Azur - Laboratoire I3S Temps plein

    **Stage de Master - Decentralized learning in the presence of heterogeneous system devices**: - Réf - **ABG-117916** - Stage master 2 / Ingénieur- Durée 6 mois- Salaire net mensuel Around 600 euros- 15/11/2023- Université Côte d'Azur - Laboratoire I3S- Lieu de travail- Sophia Antipolis Provence-Alpes-Côte d'Azur France- Champs scientifiques- Sciences...


  • Sophia Antipolis, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is made...