Back

Data Engineer - Bad Friedrichshall (m/f/d)

Full time Data Engineering Data Analytics Artificial Intelligence Software Engineering DevOps

Job Description

    • Location

      At Campus 1
      74177 Bad Friedrichshall

    • Department / Area

      IT - BI, AI & Data

    • Entry level

      Experienced professionals

    • working model

      Full-time

  • Reference number

    4231

Schwarz Digits creates the technological foundation for digital decision-making freedom in Europe. As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Produktion and PreZero. At the same time, we operate as an independent provider in the external market, supporting companies throughout Europe in their digital transformation. We combine our core services in the areas of cloud computing, cybersecurity, data & AI, communication, and workspace. Contribute to digital decision-making freedom in Europe.
With us, you'll work at the intersection of agility and security: You'll benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and build upon the stable foundation of the Schwarz Group.

Your tasks

  • ETL & Data Pipelines: You develop, operate and optimize scalable ETL/ELT pipelines for analytics and ML on GCP.
  • Lakehouse & Governance: You build data infrastructures with open-table formats (Iceberg, Delta Lake) and implement access rights (RLS/CLS), catalogs (Unity Catalog) and data validations.
  • Streaming & Messaging: You develop and maintain event-driven solutions using Apache Kafka and Apache Spark.
  • Software Excellence: You write clean, well-tested code (unit, integration & E2E tests) and apply proven software patterns.
  • DevOps & Operations: You maintain Airflow DAGs, CI/CD pipelines and Kubernetes deployments, and monitor system health to prevent outages.
  • Agile collaboration: You work closely with data scientists, product owners and business units to translate requirements into robust data solutions.

Your profile

  • You have extensive experience in data or software engineering for at least four years.
  • You have in-depth knowledge of Python development with a focus on clean software principles. JRE knowledge and practical experience with software testing are a definite plus.
  • You have practical experience in developing batch and streaming ETL pipelines . You are familiar with Apache Spark or similar frameworks.
  • You know how to handle schema evolution and maintain Lakehouse storage structures .
    Knowledge of modern open-table formats like Apache Iceberg or Delta Lake is desirable.
  • You confidently orchestrate complex workflows using Apache Airflow .
  • You have practical experience with Apache Kafka for real-time messaging and event processing.
  • You have experience working on containerized applications in cloud environments. This includes the practical use of Docker or Kubernetes, preferably in the Google Cloud Platform.
  • You apply established DevOps and software engineering practices in your daily work. This
    includes using Git, writing automated tests, and deploying code via CI/CD pipelines.
  • You take a proactive and detail-oriented approach to ensuring data integrity . You work successfully in agile team structures and always prioritize high quality.

Your contact person

Charoula Kostakopoulou

Recruiter

  • Email: recruiting@mail.schwarz

Your application process at a glance

1

Application

We love simplicity. Apply quickly and easily online, even without registration.
2

Checkup

Together with the relevant department, we will take a look at your documents.
3

Get to know

During an initial meeting, the focus is on both your personality and your professional qualifications.
4

Contract offer

Have we convinced each other? Then your employment contract will be sent to you digitally via email.
5

Welcome

Your first day with us is coming up and your individual onboarding with the team is starting. We're looking forward to meeting you!
Schwarz Digits KG
About Schwarz Digits KG
We are the technology partner for a sovereign digital Europe. Through our digital products and services, we ensure maximum digital sovereignty. Our core expertise includes Cloud, Cybersecurity, Data and AI, Communication, and Workspace. We create the ideal environment for developing pioneering innovations for end customers, companies, and public sector organizations. As the IT and digital division of the Schwarz Group, our 8,000 employees provide the IT infrastructure and solutions for a vast ecosystem. In doing so, we are driving the future-proof development of both the entire organization and ourselves. Christian Müller, Co-CEO of Schwarz Digits: "Backed by the strength of Europe’s largest retailer, we build sovereign, reliable, and trustworthy IT solutions and digital services. Our unique selling point is that we are our own most demanding customer: We only offer IT solutions to the market - such as our STACKIT Cloud or XM Cyber’s security offerings - once they have proven to be stable and create real value within our own extensive and complex IT infrastructure." Rolf Schumann, Co-CEO of Schwarz Digits: "The importance of digital solutions has grown tremendously over the last decade. By offering digital products and services to the external market, we have developed promising business models that have gained significant momentum, especially in recent years. We are convinced that Schwarz Digits will further boost the visibility and scalability of our digital solutions and services." Get to know us here and at https://schwarz-digits.de/en https://schwarz-digits.de/en/imprint | https://schwarz-digits.de/en/privacy-policy
Apply Now