Engineer: Data Placement and Retrieval in Erasure
il y a 5 jours
Le descriptif de l’offre ci-dessous est en Anglais_
**Contrat renouvelable **:Oui
**Niveau de diplôme exigé **:Bac + 5 ou équivalent
**Fonction **:Ingénieur scientifique contractuel
**A propos du centre ou de la direction fonctionnelle**:
The Inria Centre at Rennes University is one of Inria's eight centres and has more than thirty research teams. The Inria Centre is a major and recognized player in the field of digital sciences. It is at the heart of a rich R&D and innovation ecosystem: highly innovative PMEs, large industrial groups, competitiveness clusters, research and higher education players, laboratories of excellence, technological research institute, etc
**Contexte et atouts du poste**:
**Financial and working environment.**
The position is for one year, with the possibility of an extension to 18 months.
About Hive:
Hive intends to play the role of a next generation cloud provider in the context of Web 3.0. Hive aims to exploit the unused capacity of computers to offer the general public a greener and more sovereign alternative to the existing clouds where the true power lies in the hands of the users. It relies both on distributed peer-to-peer networks, on the encryption of end-to-end data and on blockchain technology.
**Mission confiée**:
**Context**:
**Objectives**:
The goal of this engineer position is to implement existing Erasure coding families in Go and to develop new data placement and retrieval stratifies for erasure coded IPFS [8]. The engineer will work closely with a PhD student on this topic.
[1] H. Chen, H. Zhang, M. Dong, Z. Wang, Y. Xia, H. Guan, and B. Zang. “Efficient and available in
- memory KV-store with hybrid erasure coding and replication”. In: ACM Transactions on Storage (TOS) 13.3 (2017), pp. 1-30. doi: 10.1145/3129900.
[3] J. Darrous, S. Ibrahim, and C. Pérez. “Is it Time to Revisit Erasure Coding in Data-Intensive Clusters?” In: 27th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2019, Rennes, France, October 21-25, 2019. IEEE Computer Society, 2019, pp. 165-178. doi: 10.1109/MASCOTS.2019.00026.
[4] Z. Zhang, A. Deshpande, X. Ma, E. Thereska, and D. Narayanan. Does erasure coding have a role to play in my data center? Tech. rep. MSR-TR-2010-52. May 2010.
[5] K. V. Rashmi, M. Chowdhury, J. Kosaian, I. Stoica, and K. Ramchandran. “EC-Cache: Load-Balanced, Low-Latency Cluster Caching with Online Erasure Coding”. In: 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016, Savannah, GA, USA, November 2-4, 2016. Ed. by K. Keeton and T. Roscoe. USENIX Association, 2016, pp. 401-417.
[6] J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. “OceanStore: An Architecture for Global
- Scale Persistent Storage”. In: SIGPLAN Not. 35.11 (Nov. 2000), pp. 190-201. issn: 0362-1340. doi: 10.1145/356989.357007.
[7] R. Rodrigues and B. Liskov. “High Availability in DHTs: Erasure Coding vs. Replication”. In: Peer-to-Peer Systems IV, 4th International Workshop, IPTPS 2005, Ithaca, NY, USA, February 24-25, 2005, Revised Selected Papers. Ed. by M. Castro and R. van Renesse. Vol. 3640. Lecture Notes in Computer Science. Springer, 2005, pp. 226-239. doi: 10.1007/11558989\_21.
[8] J. Benet. “IPFS - Content Addressed, Versioned, P2P File System”. In: CoRR abs/1407.3561 (2014). doi: 10.48550/arXiv.1407.3561. arXiv: 1407.3561.
**Principales activités**:
- Implement several erasure coding families in Go and integrate them within IPFS
- Study new algorithms for data placement and retrieval
- Prototype key algorithms
- Run experiments and Evaluation of results
- Reporting, disseminating and presenting results
**Compétences**:
- Engineering and/or Master 2 degree in Computer science
- Good knowledge in distributed systems
- Software development skills: Python and Go
- Knowledge on storage and file systems
- Good collaborative and networking skills
- Excellent written and oral communication in English
**Avantages**:
- Subsidized meals
- Partial reimbursement of public transport costs
- Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
- Possibility of teleworking (after 6 months of employment) and flexible organization of working hours
- Professional equipment available (videoconferencing, loan of computer equipment, etc.)
- Social, cultural and sports events and activities
- Access to vocational training
- Social security coverage
**Rémunération**:
The engineer will receive a salary of €2,695 gross per month, based on their profile.
**Informations générales**:
- **Thème/Domaine**: Systèmes distribués et intergiciels
Système & réseaux (BAP E)
- **Ville**: Rennes
- **Centre Inria**: Centre Inria de l'Université de Rennes
- **Date de p
-
Data Engineer
il y a 2 jours
Rennes, France Resource Solutions - GSC Temps plein**Role Title: Data Engineer** **Role Type: Permanent** **Location: Rennes (Hybrid)** **Opportunity Overview**: We are currently supporting one of the leading global food chemicals organisations to recruit for a Data Engineer/Analyst. **Key responsibilities** - Program data assets, products, pipelines, ETL and components that adhere to technical...
-
Python and Kubernetes Software Engineer
il y a 1 semaine
Rennes, France Canonical Temps pleinPython and Kubernetes Software Engineer - Data, AI/ML & Analytics4 months ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough...
-
Prompt Engineer
il y a 1 semaine
Rennes, Bretagne, France OneSource Consulting Temps pleinJob Description - Roles and ResponsibilitiesPosition Title:Junior AI Prompt and Context EngineerMission Context:As part of the deployment ofgenerative artificial intelligence solutions for business applications, the client is seeking aJunior AI Engineercapable ofdesigning, implementing, and industrializing AI systemsbased on existing models (LLM, NLP,...
-
Remote Lead Data Governance Engineer
il y a 1 semaine
Rennes, France Canonical Temps pleinA leading open-source software provider is hiring a Lead Data Governance Engineer responsible for establishing data governance policies and automating data management processes. Ideal candidates will have a strong academic background and experience in data quality and governance, with skills in Python and SQL. This remote position includes opportunities for...
-
Data Engineer: Secure AI for Defense
il y a 1 semaine
Rennes, France Thales Temps pleinA leading technology company in Rennes is seeking a Data Engineer specializing in AI solutions for defense and critical infrastructure. This role involves utilizing advanced data engineering skills to enhance data accessibility and security, collaborating closely with a strong team of experts. The ideal candidate will possess a Master’s degree and...
-
Software Engineer
il y a 1 semaine
Rennes, France Canonical Temps pleinSoftware Engineer - Data Infrastructure - Kafka Join to apply for the Software Engineer - Data Infrastructure - Kafka role at Canonical Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops managed solutions for a full range...
-
Python ML Data Platform Engineer — Remote
il y a 1 semaine
Rennes, France IDnow Temps pleinA leading identity verification firm in Rennes is seeking a Machine Learning Engineer to design and manage data solutions for their AI R&D teams. The role involves developing tools, managing data storage, and ensuring quality in CI/CD workflows within a collaborative environment. Candidates should have a solid background in Python, API development, and SQL...
-
Lead Data Governance Engineer
il y a 1 semaine
Rennes, France Canonical Temps pleinCanonical is a leading provider of open-source software and operating systems for global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers, and...
-
Data Engineer
il y a 1 semaine
Rennes, France Thales Temps pleinData Engineer - IA Défense F/H Location: Rennes, France. Based in Rennes. Company: Thales – a global leader in high‑tech defense, aviation & spatial, and cyber & digital. Thales invests around €4 billion annually in research & development, focusing on AI, cybersecurity, quantum, cloud, 6 G, and more. The group employs about 81 000 people across...
-
Community Engineer
il y a 1 semaine
Rennes, France Canonical Temps pleinCommunity Engineer (multiple roles and seniority levels)Join to apply for the Community Engineer (multiple roles and seniority levels) role at CanonicalCommunity Engineer (multiple roles and seniority levels)1 day ago Be among the first 25 applicantsJoin to apply for the Community Engineer (multiple roles and seniority levels) role at CanonicalOur ambition...