Big Data Engineer (m/f/d)

  • TecAlliance
  • Cologne, Germany
  • 11/07/2022
Full time Data Science Big Data Statistics DevOps

Job Description

Build and further develop our big data platform.

job definition

  • Together with the team, you actively build and further develop our big data platform
  • With the help of modern, cloud-based technologies and approaches you implement:
    • Scalable data preparation and data transformation processes
    • A historicized data lake, including the required data export interfaces
    • A data dashboard for reporting and quality analysis

Job qualification

  • After completing vocational training or studying in an IT-related field, you have gained several years of professional experience in Big Data and/or Data Engineering
  • AWS technologies (including Lambda, StepFunctions, Glue, S3) are familiar to you
  • You have a solid knowledge of Python and PySpark and preferably experience with Apache Hudi
  • Analytical thinking and the ability to abstract are part of your repertoire
  • You confidently represent your opinion in the team, share your knowledge and promote the exchange of experiences in order to establish a common ground base of team success
  • You follow technological developments & trends and actively contribute ideas and impulses for continuous improvement
  • You enjoy living our agile values: Appreciation, openness, trust, respect and transparency
  • Fluent knowledge of English, intercultural skills and a willingness to occasionally travel to other company locations complete your profile.