Phd Position F/m Topology Design for Decentralized
Il y a 6 mois
Le descriptif de l’offre ci-dessous est en Anglais_
**Type de contrat **:CDD
**Niveau de diplôme exigé **:Bac + 5 ou équivalent
**Fonction **:Doctorant
**A propos du centre ou de la direction fonctionnelle**:
The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is made up of scientists of different nationalities, engineers, technicians and administrative staff. The teams are mainly located on the university campuses of Sophia Antipolis and Nice as well as Montpellier, in close collaboration with research and higher education laboratories and establishments (Université Côte d'Azur, CNRS, INRAE, INSERM...), but also with the regiona economic players.
With a presence in the fields of computational neuroscience and biology, data science and modeling, software engineering and certification, as well as collaborative robotics, the Inria Centre at Université Côte d'Azur is a major player in terms of scientific excellence through its results and collaborations at both European and international levels.
**Contexte et atouts du poste**:
The research activity will be supervised by
**Mission confiée**:
Topology Design for Decentralized Federated Learning
# Context
In the classic FL setting, a server coordinates the training phase. At each training round, the server sends the current model to the clients, which individually train on their local datasets and send model updates to the server, which in turn aggregates them (often through a simple averaging operation). In contrast to this client-server approach, decentralized FL algorithms (also called P2P FL algorithms) work by having each client communicate directly with a subset of the clients (its neighbours): this process alternates between model updates and weighted averaging of the neighbours' models (consensus-based optimization). Decentralized algorithms can take advantage of good pairwise connectivity, avoid the potential communication bottleneck at the server [marfoq20] as well as provide better privacy guarantees [cyffers22].
The communication graph (i.e., the graph induced by clients' pairwise communications) and the local clients' aggregation strategies play a fundamental role in determining FL algorithms' convergence speed. In particular, the communication topology has two contrasting effects on training time. First, a more connected topology leads to faster convergence in terms of number of communication rounds [nedic18]. Second, a more connected topology increases the duration of a communication round (e.g., because it may cause network congestion), motivating the use of degree-bounded topologies where every client sends and receives a small number of messages at each round [lian17]. Most of the existing literature has focused on one aspect or the other.
The classic literature on consensus-based optimization has quantified the effect of the communication topology on the number of rounds through worst-case convergence bounds in terms of the spectral gap of the consensus matrix (i.e., the matrix with the averaging weight), see [nedic18] and references there. Later papers have highlighted the convergence rate' insensitivity to the spectral gap for a large number of communication rounds and small learning rates [lian17,koloskova21,pu20].
Another line of work has shown that the effect of the topology is less important if local data distributions [neglia20] or average data distributions in each neighborhood [lebars23,dandi22] are close to the average data distribution over the whole population. In the extreme case of homogeneous local distributions, one may even prefer consensus matrices with poor spectral properties because they enable the use of larger learning rates [vogel22].
A separate line of works has studied how to design the communication topology in order to minimize the duration of one round, taking into account the variability of the computation times [neglia19] or the characteristics of Internet connections [marfoq20].
# Research objectives
The goal of this PhD is to propose algorithms to design the communication topology for decentralized federated learning with the goal of minimizing the total training duration, taking into account how connectivity affect both the number of rounds required and the duration of a single round.
Several settings will be considered: in particular, one may construct the topology in a pre-processing step (prior to learning), or dynamically while learning. Dynamic topology design can be a way to tackle online decentralized learning [asadi22,marfoq23], where the topology is adjusted and refined as clients collect more data.
Finally, he/she will also study to what extent the existing results can be extended to asymmetric communication links and other distributed optimization algorithms like push-sum ones [kempe03,benezit10].
# References
[asadi22] M. Asadi, A. Bellet, O.A. Maillard and M. Tommasi. Collaborative Algorith
-
Phd Thesis
Il y a 4 mois
Sophia Antipolis, France Laboratoire I3S - CNRS (UMR 7271) Temps plein**PhD Thesis - Error-Correction Codes for Reliable DNA Storage**: - Réf **ABG-125677** - Sujet de Thèse- 05/09/2024- Contrat doctoral- Laboratoire I3S - CNRS (UMR 7271)- Lieu de travail- Sophia Antipolis - Provence-Alpes-Côte d'Azur - France- Intitulé du sujet- PhD Thesis - Error-Correction Codes for Reliable DNA Storage- Champs scientifiques- Science...
-
Phd Position F/m Phd Position Computer Vision
Il y a 6 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Université Côte d’Azur center counts 36 research teams as well as 7 support departments. The center's staff (about 500 people...
-
Phd Position F/m Privacy On-demand and Security
Il y a 6 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Bac + 5 ou équivalent**Fonction **:DoctorantA propos du centre ou de la direction fonctionnelle Le centre Inria d'Université Côte d'Azur regroupe 37 équipes de recherche et 8 services d’appui. Le personnel du centre (500 personnes environ) est...
-
Phd Position F/m Generative Ai for The
Il y a 4 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria center at Université Côte d'Azur includes 42 research teams and 9 support services. The center’s staff (about 500 people) is...
-
Phd Position F/m Monitoring Plane for Mobile
Il y a 6 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Bac + 5 ou équivalent**Fonction **:DoctorantA propos du centre ou de la direction fonctionnelle The Inria Université Côte d'Azur center counts 37 research teams as well as 8 support services. The center's staff (about 500 people) is made up of...
-
Junior Design for Test Engineer
il y a 5 jours
Sophia Antipolis, France Menta Temps pleinFull time, based in Sophia-Antipolis, France._ **Job description** Within the Hardware DfT R&D team, you will be in charge of implementing DfT strategy for the IP - both FE and BE, with a mix of R&D and production work. This is a challenging position and an opportunity to work within a small but highly qualified team. You will get the chance to work on...
-
Phd Position F/m Fast Solvers for Studying Light
Il y a 6 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Bac + 5 ou équivalent**Autre diplôme apprécié **:Master in applied mathematics or scientific computing**Fonction **:Doctorant**Niveau d'expérience souhaité **:De 3 à 5 ansA propos du centre ou de la direction fonctionnelle The Inria centre at...
-
Phd Position, Scientific Machine Learning, Inria
Il y a 7 mois
Sophia Antipolis, France MathHire.org Temps pleinApplications are welcome at the Inria center of the University Cote d’Azur on the French Riviera situated in the vibrant technopole of Sophia-Antipolis, for a Master internship (4 to 6 months duration) followed by a three year fully funded PhD positon (to start immediately after or at commonly agreed date), in the context of a multi-partner collaborative...
-
Phd Position F/m Real-time Surgical Assistant for
Il y a 4 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria center at Université Côte d'Azur includes 42 research teams and 9 support services. The center’s staff (about 500 people) is made up of scientists of...
-
Phd Position F/m Robust Federated Learning
Il y a 2 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria center at Université Côte d'Azur includes 42 research teams and 9 support services. The center’s staff (about 500 people) is...
-
Phd Position F/m Effective Ai Based
Il y a 4 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria center at Université Côte d'Azur includes 42 research teams and 9 support services. The center’s staff (about 500 people) is...
-
Phd Position F/m Experimental Evaluation of Sliced
Il y a 6 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD**Niveau de diplôme exigé **:Bac + 5 ou équivalent**Fonction **:DoctorantA propos du centre ou de la direction fonctionnelle The Inria Université Côte d'Azur center counts 37 research teams as well as 8 support services. The center's staff (about 500 people) is made up of...
-
Phd Position F/m Compiling Dynamic Languages to
Il y a 6 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Autre diplôme apprécié **:Master thesis **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services....
-
Sophia Antipolis, France Inria Temps plein_Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat**: CDD **Niveau de diplôme exigé**: Thèse ou équivalent **Fonction**: Post-Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria centre at Université Côte d'Azur includes 42 research teams and 9 support services. The centre's staff (about 500 people) is...
-
Sophia Antipolis, France Inria Temps plein_Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat**: CDD **Niveau de diplôme exigé**: Bac + 5 ou équivalent **Autre diplôme apprécié**: Master in applied mathematics or scientific computing **Fonction**: Stagiaire de la recherche **A propos du centre ou de la direction fonctionnelle**: The Inria center at Université Côte...
-
Principal Design Evaluation Engineer
Il y a 3 mois
Sophia Antipolis, France Analog Devices Temps pleinAnalog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologies into solutions that help drive advancements in digitized factories, mobility, and digital healthcare, combat climate change, and reliably...
-
Sophia Antipolis, Provence-Alpes-Côte d'Azur, France SiPearl Temps pleinAbout SiPearlSiPearl is a European company that specializes in designing and developing high-performance, low-power microprocessors for supercomputing and AI inference. Our mission is to create a new generation of microprocessors that will revolutionize the field of supercomputing and AI.We are a team of experts in the field of microprocessor design and...
-
Systems Design Engineer
Il y a 7 mois
Sophia Antipolis, France Qualcomm Temps plein**Company**: Qualcomm France S.A.R.L. **Job Area**: Engineering Group, Engineering Group > ASICS Engineering **General Summary**: **Business Description and Job Function**: Qualcomm France-QITC develop interconnect for complex SoCs providing low power, higher system bandwidth, greater IP flexibility, fewer global wires and easier timing convergence as well...
-
Principal Analog Ic Design Engineer
il y a 14 heures
Sophia Antipolis, France IC Resources Temps pleinSalary: €75,000- €90,000 plus bonus and RSUs Job Type: Permanent - Are you looking for a stable job in a sunny beach location within Europe? Well look no further! - We have a new opportunity for a well-established company located close to Nice on the sunny and highly desired South Coast of France. - You will be joining a large design centre working...
-
Junior Audio Signal Processing Engineer
il y a 5 jours
Sophia Antipolis, France NXP Semiconductors Temps plein**Context** - NXP Sophia-Antipolis site has +200 employees composed of hardware designers, software engineers and architects. - VOICE & AUDIO team is developing speech and audio software algorithms for smart speakers and connected devices. In this context, we are looking for an audio algorithm engineer for speech enhancement. **Responsibilities** - As a...
