Lead Data Engineer (m/f/d)

The DLG Group is one of Europe's leading cooperatives in the food, energy, and building materials sectors. Our mission is to create long-term added value for our agricultural owners and for society – through reliable products, innovative solutions, and sustainable growth in all our business areas. With approximately 7,000 employees in 18 countries and based on our cooperative structure, we shape our future through shared values, sustainable goals, and a firm belief in the power of collaboration.

Team SE, headquartered in Flensburg, is an integral part of the DLG Group . Our central corporate functions are organized across locations, from Flensburg to the DLG headquarters in Fredericia. Together, we support the business units across national borders and contribute to an efficient, integrated, and future-proof organization that optimally leverages economies of scale and synergies.

You will assume technical responsibility for the data engineering team and significantly shape the technical direction of our data engineering practices across the entire company. You will write code, define standards, and support and coach other engineers. Simultaneously, you will be the central technical escalation point for complex challenges.

Your core responsibilities include:

• Leading the design, development, and optimization of enterprise-scale data solutions on Databricks
• The design and implementation of scalable data ingestion frameworks for batch and streaming workloads
• Responsibility for Databricks Asset Bundles / Declarative Automation Bundles, deployment pipelines and multi-environment configurations
• Managing data governance initiatives via Unity Catalog, including access management, storage credentials, and metadata management.
• The definition and maintenance of engineering standards such as coding practices, code reviews, documentation, and data quality frameworks.
• Coaching other data engineers and handling technical escalation for complex challenges.

You are a hands-on technical leader (m/f/d) with extensive Databricks experience. You think beyond the immediate task, keep the entire platform in mind, and make architectural decisions with a focus on scalability and long-term data strategy. You understand the connection between engineering output and business impact and find the balance between rapid delivery and sustainable governance.

We imagine that you:

• You have extensive practical experience with production-ready Databricks solutions.
• You are very confident in Python, PySpark and SQL – including complex transformations, performance optimization and query design.
• You have experience in designing Databricks Asset Bundles and deploying them across multiple environments.
• possesses in-depth knowledge of Unity Catalog, data governance, access control, and best practices in data management.
• You have built and operated CI/CD pipelines using GitHub Actions, Azure DevOps, or similar technologies.
• You can communicate architectural decisions and technical trade-offs clearly and understandably – both technical and non-technical – in German and English.

Additional advantages include:

• Experience with Databricks AI/BI Dashboards, Genie or Semantic Layer Design
• Knowledge of Azure Identity and Secrets Management, e.g., Entra ID, OIDC Federation and Azure Key Vault
• Experience in integrating GDPR and confidentiality requirements into data engineering solutions

At DLG, you will become part of an ambitious and collaborative organization where data plays an increasingly important role in innovation and business value. You will have the opportunity to actively shape our modern data platform and contribute to strategic initiatives across the company.

We offer you a flexible and supportive work environment with excellent opportunities for professional development, knowledge sharing, and career growth. You can expect a culture characterized by collaboration, trust, and continuous improvement.

We look forward to receiving your application in PDF format via our application portal, stating your salary expectations and earliest possible start date.