Senior Data Engineer

Senior Data Engineer – Big Data Predictive Team (E&M)

We are looking for a Senior Data Engineer to join the Big Data Predictive Team within Engineering & Maintenance (E&M). You will play a key role in maintaining and developing new features for Prognos for Aircraft, a predictive maintenance suite used by Air France-KLM (AFKL). This tool helps prevent Aircraft on Ground (AOG) situations and detects potential issues before they cause severe damage, ultimately saving costs and improving operational efficiency. Prognos for Aircraft is already delivering significant business value and is now being deployed to other airlines.

Your Responsibilities

• Maintain and develop new features for Prognos for Aircraft to enhance predictive maintenance capabilities.
• Work with large-scale data processing technologies such as Scala, Spark, Kafka, and Python to develop robust and scalable data pipelines.
• Implement ELT processes to ensure efficient data transformation and integration.
• Manage and optimize MongoDB databases for storing predictive maintenance data.
• Utilize NiFi/Kafka for real-time data ingestion and processing.
• Deploy and orchestrate workloads using Kubernetes.
• Collaborate with cross-functional teams using GitHub Actions, Jira, and Control-M.
• Work according to SAFe Agile principles, contributing to sprint planning, reviews, and retrospectives.
• Communicate effectively with business stakeholders and technical teams to align on priorities and project goals.
• Stay up-to-date with emerging technologies and best practices in data engineering.

Required Skills & Experience

• Strong proficiency in Scala, Spark, Kafka, Python, and MongoDB.
• Experience with NiFi/Kafka for real-time data processing.
• Solid understanding of ELT methodologies and data transformation pipelines.
• Hands-on experience with Kubernetes for container orchestration.
• Excellent coordination and communication skills, with the ability to collaborate across teams.

Nice to Have

• Cloud experience (Google Cloud Platform - GCP) or other cloud providers.
• Familiarity with Control-M for workload automation.

Work Environment

• Hybrid work model: 2 days per week in the office, with an additional knowledge-sharing day once per month.
• Agile work environment following SAFe principles.

If you are a highly skilled Senior Data Engineer with expertise in Big Data technologies and predictive analytics, and you want to contribute to a cutting-edge aviation maintenance platform, we would love to hear from you!