Data Engineer Hadoop
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
Main Responsibilities
• Implement new data ingestion processes.
• Perform data preparation/transformation processes.
• Develop, maintain, and upgrade data pipelines using PySpark.
• Perform shell scripting under Unix/Linux.
• Collaborate with the DevOps team on platform enhancement requests.
• Participate in maintaining operational readiness and developing data processing processes.
• Write technical specifications and document implemented solutions.
Essential
skills:
Excellent proficiency expected in:
• Hadoop
• Python / PySpark
• Hive
• SQL
• Unix/Linux Shell ScriptingEnvironment/Tools:
• Git
• Jenkins
• Jira
• Agile/Scrum MethodologyProfessional English is essential, both written and spoken.
Desired/Differentiating
Skills:
Experience with the following technologies would be a plus: Indexima, Alteryx, Altair, GCP, BigQuery, and API-oriented Python libraries. Ideal Candidate Profile: Data Engineer with 3 to 6 years of experience, highly proficient in the Hadoop/PySpark ecosystem, and a genuine passion for developing and processing large volumes of data. The consultant must be autonomous, proactive, a strong problem-solver, and technically curious, with excellent analytical and problem-solving skills. Strong interpersonal skills and the ability to work effectively in a team within an international environment are also essential.
Application: CV + cover letter + copies of diplomas to be sent to contact@keoni.frFounded in 2008, Kéoni Consulting is an IT consulting and engineering firm specializing in the banking, financial markets, insurance, and industrial sectors. We are the partner for major accounts in their digital transformation. We help them transform their business model, align their operational processes, select the best technologies, and mitigate and overcome the risks associated with digitalization. Kéoni Consulting helps companies to: Make a difference , innovate and create , reinvent their business, satisfy customers, gain a competitive advantage, become the leader in their sector, and become the leader in their sector. Our services cover the entire information systems lifecycle (Project Management, Business Analysis Consulting, Design, Implementation, Maintenance, Production, and Operations).Job Category: Digital Transformation
Job Type
Full TimeWork
location:
Europe
-
Data engineer Hadoop-
Il y a 5 jours
Paris, Nouvelle-Aquitaine, France VISIAN Temps plein 50 000 € - 70 000 € ContratNous recherchons un profil Hadoop / PySpark qui sera en charge, en lien avec l'équipe de production applicative / devops, de mettre en œuvre techniquement les evolutions du datalake. Passionné par le développement et le traitement des données, capable de s’adapter à un environnement dynamique et en constante évolution, le candidat doit faire preuve...
-
Data Engineer: Hadoop
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Keoni Temps plein 55 000 € - 90 000 € ContratKeoni is seeking a Data Engineer to join its European team to design and implement data ingestion, transformation, and analytics pipelines. You will work with Hadoop, PySpark, Hive, SQL, and Unix/Linux shell scripting to deliver robust data solutions.The ideal candidate has 3–6 years of experience, is autonomous, proactive, and collaborative within an...
-
Data Engineer — ML Pipelines
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Size Up Consulting Temps plein 55 000 € - 75 000 € ContratSize Up Consulting recherche un Data Engineer pour piloter la collecte et la transformation des données sur une plateforme Hadoop Cloudera. Vous industrialiserez les algorithmes de Machine Learning et faciliterez l’exploitation data pour analyses et décisions.Vous réaliserez la maintenance Hadoop, gérerez l’ordonnancement via ctrlM et contribuerez à...
-
Hadoop & PySpark Data Engineer – Data Lake & Pipelines
Il y a 5 jours
Paris, Nouvelle-Aquitaine, France VISIAN Temps plein 50 000 € - 70 000 € ContratNous recherchons un profil Hadoop / PySpark qui sera en charge, en lien avec l'équipe de production applicative / devops, de mettre en œuvre techniquement les évolutions du datalake. Passionné par le développement et le traitement des données, capable de s’adapter à un environnement dynamique et en constante évolution, le candidat doit faire preuve...
-
Senior Data Developer: Python, SQL
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Keoni Temps plein 60 000 € - 90 000 € ContratKeoni is seeking a Data Developer with 5+ years of experience in Python, SQL, Shell and Spark to support CLoudera Hadoop-based data platforms. You will develop and maintain data ingestion, populate the Datalake, and provide user support in a high-demand production environment.You will mentor juniors, review code, and ensure delivery deadlines while improving...
-
Data Finance
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Keoni Temps plein 52 000 € - 78 000 € ContratKeoni Consulting seeks a Business Analyst to join the IT Data Management & BI department within the Data Financing & Risk team. The role focuses on leading data-related projects, ongoing maintenance, and production support across Financing and Risk business lines.You will communicate with stakeholders, write specifications, model data, and ensure...
-
Data & AI Engineer
Il y a 1 jour
Paris, Nouvelle-Aquitaine, France Aimlroles Temps plein 54 000 € - 82 000 € ContratJob title: Data & AI Engineer Location: Paris, France Work Arrangements: Hybrid (Monday, Tuesday, Wednesday onsite) About the job As a data & AI engineer within our Digital Commercial Accelerator team, you will support efforts to revolutionize how Sanofi delivers life‑saving medicines through data, AI and digital innovation. This role offers an excellent...
-
Data Engineer
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Atlanse Temps plein 60 000 € - 90 000 € ContratRôleEn tant que Data Engineer, vous jouerez un rôle clé dans la gestion, l’organisation et l’optimisation des données, garantissant l’efficacité des traitements et l’accessibilité des informations stratégiques. Vous concevez, déployez et maintenez les infrastructures de données.ResponsabilitésArchitecture de données : concevoir et...
-
Data Engineer
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Harmattan-AI Temps plein 90 000 € - 140 000 € ContratAbout UsHarmattan AI is a next-generation defense prime building autonomous and scalable defense systems. Following the close of a $200M Series B, valuing the company at $1.4 billion, we are expanding our teams and capabilities to deliver mission-critical systems to allied forces.Our work is guided by clear values: building technologies with real-world...
-
Data Engineer
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Sijo Temps plein 60 000 € - 90 000 € ContratConcevoir et implémenter des pipelines d'ingestion et de transformation de données (batch et temps réel), robustes et scalables.Développer et maintenir les flux ETL Talend qui alimentent le datalake et les systèmes consommateurs.Développer des traitements Python / PySpark sur Databricks et mettre en œuvre les modèles de données cibles.Automatiser...