Senior Data Engineer

il y a 4 jours

AnyMartinRieux, Hauts-de-France Architecture in Motion Inc. Temps plein

Title: Senior Data Engineer Location: Pakistan

Role Type: Fulltime

Time: Eastern Standard Time (EST)

Responsibilities:

  • Design, implement, and maintain data platforms and pipelines leveraging Microsoft Fabric, Azure Data Factory (ADF), SQL Server, and SSIS.
  • Develop and optimize ETL/ELT workflows for structured and unstructured data using ADF, Fabric Dataflows, and PySpark.
  • Integrate data from multiple sources (APIs, relational, and non-relational databases) into Lakehouse and SQL Server
  • Implement data transformation and cleansing logic using Python, PySpark, and Fabric notebooks.
  • Collaborate with Data Science and BI teams to prepare datasets for analytics, dashboards, and machine learning models.
  • Design and enforce data modeling best practices, including dimensional modeling for data warehouses.
  • Automate workflows using Power Automate for notifications, approvals, and orchestration of data refresh processes.
  • Monitor and improve data pipeline performance, ensuring scalability and reliability.
  • Manage metadata and data cataloging within Microsoft Fabric for discoverability and governance.
  • Develop incremental and real-time data ingestion strategies for large datasets.
  • Ensure compliance with data security and governance policies across all environments.
  • Provide technical guidance and mentorship to junior data engineers.

Requirements

  • Bachelor's degree in Computer Science, Data Engineering, or related field.
  • 5+ years of experience in data engineering with strong expertise in:
  • Microsoft Fabric (Lakehouse, Dataflows, Pipelines)
  • Azure Data Factory (ADF) and SSIS
  • SQL Server (T-SQL, stored procedures, performance tuning)
  • Python and PySpark for data processing
  • Hands-on experience with ETL/ELT design, data warehousing, and dimensional modeling.
  • Familiarity with Power Automate for workflow automation.
  • Strong understanding of data governance, metadata management, and security best practices.
  • Experience with incremental loads, CDC (Change Data Capture), and real-time streaming.
  • Ability to troubleshoot and optimize data pipelines for performance and cost efficiency.
  • Excellent communication skills for cross-functional collaboration.
  • Knowledge of Azure services (Key Vault, Storage, Synapse) and Fabric integration.
  • Self-starter with a proactive approach to problem-solving and continuous improvement.

  • Senior Data Engineer

    il y a 6 jours

    Any-Martin-Rieux, Hauts-de-France Architecture in Motion Inc. Temps plein

    Job ResponsibilitiesData Ingestion and Integration: You will need to ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure using services such as Azure Data Factory for ETL jobs.Data Transformation and Processing: Large-scale data transformation and processing tasks to prepare the data for analysis and reporting...

  • Senior AI/ML Engineer

    il y a 4 jours

    Any-Martin-Rieux, Hauts-de-France Architecture in Motion Inc. Temps plein

    Senior AI/ML Engineer (Remote) Pakistan Only Role SummaryWe are seeking a skilled AI/ML Engineer to design, build, and deploy generative AI solutions using Python, Hugging Face, and Azure cloud services (Azure is our stack, but strong AWS/GCP experience is welcome). You will own the full lifecycle of AI/ML model development from prototyping through...

  • AI Test Engineer

    il y a 2 semaines

    Any-Martin-Rieux, Hauts-de-France Qualitest acq Temps plein

    Are you interested in working with the World's leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at QualitestWe are looking for a AI Test Engineer to join our growing team in Argentina/CanadaRole - AI Test EngineerLocation - Remote...

  • SAP Test Data

    il y a 1 heure

    Any-Martin-Rieux, Hauts-de-France Qualitest acq Temps plein

    Start Date: Monday 17th Nov 2025B2 SAP Test Data / Automation ConsultantOffshore Resource to support UK hoursClear communication and key stakeholder management skills is key.Requirement / problem status:AMP8 Optimus YR1 project will focus on maturing several key aspects of our quality assurance practices, including but not limited to:Improving test data...

  • Senior Application Developer-Python+GenAI

    il y a 1 semaine

    Any-Martin-Rieux, Hauts-de-France Qualitest acq Temps plein

    Senior Application Developer – Cloud-Native, AI/ML & GenAI SystemsSkill Focus:Cloud-Native Development (4/5) | AI/ML Integration (4/5) | GenAI Systems (3/5)Role OverviewWe are seeking a Senior Application Developer with strong expertise in cloud-native backend development and hands-on experience integrating modern AI/ML and Generative AI (GenAI)...

  • Senior .NET AI Developer

    il y a 1 semaine

    Any-Martin-Rieux, Hauts-de-France Architecture in Motion Inc. Temps plein

    Senior .NET AI Developer (Remote)Job Summary:We are looking for an experienced Senior .NET AI Developer to lead the design, development, and deployment of our AI-driven solutions and services using the Microsoft .NET ecosystem. This role involves establishing a robust in-house AI development pipeline and integrating cutting-edge generative AI capabilities...

  • Data Scientist in QE

    il y a 4 jours

    Any-Martin-Rieux, Hauts-de-France Qualitest acq Temps plein

    Are you interested in working with the World's leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at QualitestWe are looking for a Data Scientist in QE to join our growing team in Argentina/MéxicoRole - Data Scientist in QELocation -...

  • Senior Solution Architect

    il y a 2 semaines

    Any-Martin-Rieux, Hauts-de-France Architecture in Motion Inc. Temps plein

    Role OverviewWe are seeking a well-rounded Senior Solution Architect with 15+ years of experience across .NET, Java, and Cloud technologies (Azure, AWS, or GCP) to lead architecture, solution design, and technology strategy for complex enterprise projects.This role is both client-facing and technically hands-on, requiring the ability to translate business...

  • Senior Software Engineer, Italy

    il y a 2 semaines

    Any-Martin-Rieux, Hauts-de-France ION Temps plein

    Who We AreWe're visionary innovators who provide trading and workflow automation solutions, high-value analytics, and strategic consulting to corporations, financial institutions, central banks, and governments. More than 40% of the world's largest companies use our solutions. We've achieved tremendous growth by bringing together some of the best and most...

  • Senior UI Designer

    il y a 2 semaines

    Any-Martin-Rieux, Hauts-de-France ION Temps plein

    The opportunityWe are looking for a talented Senior UI Designer to join a new design team. You will be working with Product Managers, Designers and Engineers to deliver market leading products which deliver the highest impact, usability and success.You will be central to establishing our visual language and ways of working as we start designing complex...