Crush your SAP career goals.

Get the guidance, resources, and connections you need to secure your next role                

  • Home
  • Jobs
  • Data Platform Operations Engineer - Databricks/Airflow

Data Platform Operations Engineer - Databricks/Airflow

Jobs post

  • Netherlands, Western Europe Location
  • EUR450 - EUR500 per day Salary
  • Data & Analytics Technology
  • Contract Type
  • Remote Workplace
Apply now

Data Platform Operations Engineer - Databricks/Airflow / Remote EU / 6 months + / Start ASAP


As a Data Engineer in Data Platform, you will be supporting 1000+ stakeholders focusing on data transformation and pipeline orchestration technologies. By constantly challenging the status quo, you will ensure stakeholder teams to deliver high-performance data processing solutions that are efficient and remain reliable at scale

Where your experience is needed:

* Automation of support activities (e.g cluster creations, configuration changes)
* Improving documentation to address user inquiries
* Prioritising customer queries and escalating serious technical issues to 2nd level
* Operational Excellence
* Stakeholder support through chat and support tickets
* Troubleshooting user issues related to Databricks (Spark) / Airflow and suggesting optimisation's for long running or resource intensive jobs
* Guiding users on best practices of Databricks and Airflow cluster management
* Consult and help our diverse teams to develop, implement and maintain sustainable, high-performance, growth-ready data-processing and data integration systems
* Having documentation focus to improve user journey

SKILL SET - Technical:

* Basic understanding of distributed data processing frameworks like Apache Spark
* Understanding of relational database management systems
* Hands-on experience with Databricks
* Hands-on experience with Apache Airflow/Amazon Managed Workflows for Apache Airflow
* Hands-on experience with Python combined with SQL knowledge
* Hands-on experience in cloud technologies (AWS services like S3, EC2, IAM, Cloudformation)
* Hands-on experience in container/orchestration tools (Kubernetes, Docker, Podman)
* Engineering craftsmanship with an experience in software development processes focusing on testing, continuous integration/continuous delivery (CI/CD), monitoring and writing documentation

Nice to have:
* Knowledge on AWS Step Functions, Cloudwatch, Lambda

Must have skills:
* Amazon Web Services
* Apache Airflow
* Databricks
* Python


Apply now

You might also like…

Related Jobs

Data Analyst
  • Amsterdam, Noord Holland, Netherlands, Western Europe
  • EUR40 - EUR45 per hour

Data Analyst / Amsterdam onsite / 6 months / Start ASAPMore or less with similar skillset like Data...

Data Engineer - ETL Developer Informatica
  • Sweden, Western Europe
  • EUR35 - EUR40 per hour

Data Engineer - ETL Developer Informatica / Remote / 12 months / Start ASAPDescription:As a Data...

APM Infrastructure Engineer
  • Lithuania, Eastern Europe
  • EUR35 - EUR40 per hour

APM Infrastructure Engineer / Remote / 6 months / Start ASAPYears of experience:...

AWS Data Architect
  • Sweden, Western Europe
  • EUR500 - EUR550 per day

AWS Data Architect / Remote EU / 6 months / Start ASAPProject description:This project is for a...

MS Dynamics 365 functional Consultant
  • Spain, Western Europe
  • Negotiable

*** SAP MS Dynamics 365 functional Consultant 3 months - Remote *** RED now has a new opportunity...

Microsoft BI, MSSQL & MSDWH Consultant
  • Vienna, Austria, Western Europe
  • Verhandelbar

Aktuell suchen wir nach zwei externen Microsoft Consultants (w/m/d) für die freiberuflichen...

Data Analyst/Engineer in Support of ACT Architectural Coherence
  • Virginia, United States of America, North America
  • USD80 - USD90 per hour

Data Analyst/Engineer in Support of ACT Architectural Coherence / Norfolk, VA, USA / 5 year contract...

IOS Objective C Expert
  • Vilnius, Lithuania, Eastern Europe
  • EUR30 - EUR40 per hour

IOS Objective C Expert / Vilnius onsite / 3 months / Start ASAPYears of experience: 8 years We are a...

Data Software Engineer - Scala/Elasticsearch
  • Netherlands, Western Europe
  • EUR450 - EUR500 per day

Data Software Engineer - Scala/Elasticsearch / Remote EU / 6 months + / Start ASAPProject...

Data Platform Operations Engineer - Google Cloud
  • Netherlands, Western Europe
  • EUR450 - EUR500 per day

Data Platform Operations Engineer - Google Cloud / Remote EU / 6 months + / Start...

SAP Integration manager
  • Paris, France, Western Europe
  • Negotiable

Our international client in France, has a requirement for | SAP Integration Manager to join their...

SAP Business Consultant - LATAM Based - Fully Remote
  • Mexico City, Mexico, North America
  • Fully Remote

*** Business Consultant - LATAM Based - Remote*** For our international client based in Europe, RED...

SAP SD OTC E-Invoicing Consultant - Poland
  • Warsaw, Poland, Eastern Europe
  • Negotiable

*** SAP SD OTC E-Invoicing Consultant - 6 months + ext. - Poland/Remote (Hybrid) *** RED now has a...

Power BI Data Visualisation Expert
  • Spain, Western Europe
  • Negotiable


SAP TM Consultant
  • Poland, Eastern Europe
  • Negotiable

RED Global now has an urgent opportunity for a SAP TM (Transportation Management) Consultant to join...

Azure Data Engineer
  • Spain, Western Europe
  • Negotiable


Azure/BizTalk Developer - 12+ Months - Remote - Start ASAP
  • Dusseldorf, Germany, Western Europe
  • Verhandelbar

For our client in NRW we are looking for an Azure/BizTalk Developer.The integration team of our...

S4/HANA MM-Consultant
  • Germany, Western Europe
  • Negotiable

Im Auftrag eines unserer Dienstleister suchen wir für ein mit internationales Automotiveunternehmen...

Für unseren Kunden aus Frankfurt suchen wir einen Applikationsmanager.Ihre Hauptaufgabe besteht...

SAP Logistic Consultant (w/m/d) Anbindung einer Zollsoftware
  • Stuttgart, Germany, Western Europe
  • Verhandelbar

Rahmendaten:Projektstart: ASAPLaufzeit: bis Ende 2024 mit Option auf VerlängerungAuslastung: 4-5...

SAP BPC Experte - 3+ Monate - Remote
  • Hamburg, Germany, Western Europe
  • Negotiable

Für unseren Kunden suchen wir mehrere SAP BPC Experten für den Bereich Controlling zur...

Solution Architect PLM
  • Germany, Western Europe
  • Negotiable

Solution Architect PLM - 5+ months - Mainly remote/Some on site work in Germany - Start...

View all

Register with RED Global.


By registering with RED Global, you’ll receive personalised job alerts, get instant access to hundreds of new SAP and tech roles, and be able to apply for jobs quickly and easily. Register today to reap the rewards of becoming a RED Global candidate.


Register with RED Global.