Senior Data Engineer (m/f/d)

Location: Hannover / Remote

Syscrest creates a dynamic, diverse and innovative work environment. We are looking for an experienced Senior Data Engineer who not only brings technical expertise but is also able to inspire and encourage our team of junior developers. We offer the opportunity to expand your knowledge in the latest Big Data technologies and expect a passion for continuous learning and improvement.

Requirements

• Successfully completed studies in computer science, mathematics or a related technical field.
• At least 5 years of experience implementing robust, distributed and scalable data processing using Java/JVM-based languages ​​or Python.
• At least 5 years of experience in data engineering.
• In-depth knowledge of data modeling, data architecture and data pipelines.
• Experience in working with large amounts of data and performance optimization.
• Experience in dealing with ETL processes and data modeling
• Sense of responsibility, initiative and ability to work in a team.
• Experience in agile working methods.
• Very good knowledge of English (C1 or C2).
• Willingness to travel occasionally.

technology knowledge

• Programming languages: Python, Java, Scala, SQL, R

• Database management systems (DBMS): Relational databases such as MySQL, PostgreSQL, Oracle, SQL Server. NoSQL databases such as MongoDB, Cassandra, Couchbase

• Big Data technologies: Hadoop, Apache Spark, Apache Kafka for real-time data streams

• Data warehousing solutions: Amazon Redshift, Google BigQuery, Snowflake, Teradata

• Cloud platforms: AWS, Azure, GCP - especially services such as Redshift, EMR, Serverless, Azure SQL Database, Azure Data Factory, Azure Fabric, BigQuery, Dataflow, Cloud Storage

• Containerization and orchestration: Docker, Kubernetes

• Data governance and data quality tools: Collibra, Talend Data Quality, Informatica Data Quality

• Data visualization and business intelligence tools: Tableau, Power BI, Qlik Machine Learning and Advanced Analytics: TensorFlow, PyTorch, Scikit-learn

• Automation and CI/CD tools: git, Jenkins, GitLab CI, github Monitoring and logging tools: ELK Stack, Prometheus, Grafana

We offer

• Possibility of home office with flexible working hours.
• Extensive training and development opportunities.
• Short decision-making processes and independent scope for action.
• Mature process models in efficient development environments.
• Permanent position, unlimited, full-time, 30 days vacation.
• Attractive salary package and additional benefits (e.g. job ticket)

Your tasks

• Designing and implementing robust, scalable data architectures. Developing and optimizing data pipelines, data models and ETL processes.

• Managing and optimizing large, complex databases. Ensuring data quality and integrity in collaboration with data analysts and business intelligence teams.

• Deployment and management of big data technologies such as Hadoop, Spark, Kafka. Work with cloud data solutions and services (AWS, Azure, Google Cloud).

• Guiding and supporting junior data engineers and other team members. Promoting best practices within the team and taking responsibility for the technical leadership of projects.

• Support in the implementation of machine learning models and advanced analytics solutions. Collaboration with data scientists to integrate analytical models into the data infrastructure.

• Developing and implementing automation strategies for data processes. Applying CI/CD practices for efficient and error-free software development.

• Optimizing the performance of databases and data processing processes. Identifying and resolving performance bottlenecks and technical problems.

• Active participation in researching and implementing new technologies and tools. Monitoring market trends and evaluating their applicability for current and future projects.

• Creating comprehensive technical documentation for data architectures and processes. Ensuring that knowledge is shared effectively within the team

Please send your application in the form of a PDF file exclusively by email to jobs@syscrest.com.

Note: We welcome applications from people of all genders and backgrounds.