Big Data Engineer

  • Odysseus Data Services
  • Berlin, Germany
  • 03/08/2022
Full time Data Engineering Big Data Software Engineering DevOps

Job Description

Job Description

employment type
permanent employment

Full job description

Odysseus Data Services - is a fast-growing American company working closely together with the Observational Health Data Sciences and Informatics (or OHDSI, pronounced "Odyssey", consortium, whose main mission is to improve health care systems around the world by collecting and organizing data on the treatment of various diseases and then combining this data into a single, standardized, universally accessible knowledge base to bring out the value of health data through large-scale analytics. Due to our rapid growth, we now have a vacancy for a Big Data Engineer in the city of Berlin.


    • Data Management and Big Data Engineering eg complex ETL, data analysis, data mappings, advanced transformations
    • Architect and utilize Big Data Platforms for Big Data projects
    • Develop solutions in Agile fashion following Scrum process and Test-Driven approach enabled with Atlassian tools (JIRA, Confluence)
    • Develop solutions by applying industry best practices and coding standards
    • Document architecture design by creating necessary architecture artifacts, including UML domain models, component and deployment diagrams. Document business requirements as user stories
    • Create prototypes and POCs, as needed
    • Design secure and compliant solutions by implementing necessary application security and following various regulatory laws (HIPAA, GDPR)
  • And: Be a part of the dynamic open-source observational research OHDSI community, participate in workshops, hackathons and collaborate to implement observational research solutions eg have a fun time developing cutting-edge solutions

  • Required skills

      • BS or MS degree in Information Technology or Computer Science — or equivalent experience in information technology and software development
      • Complex SQL, including Spark SQL, Hive QL
      • Practical experience with ETL and big data processing
      • Practical experience with RDBMS (any of the following - Oracle, PostgreSQL, SQL Server)
      • Practical experience with MPP databases (any of the following - AWS RedShift, BigQuery, Synapse)
      • Practical experience with Hadoop eg Spark, Hive, Impala
      • Practical experience with one of the following platforms: AWS, GCP and Cloudera
      • Experience designing and developing solutions using Agile software development approach

    Desired skills

    • Experience in administering the Big Data platform infrastructure
  • Knowledge of Java and Python

    • Experience in solving DevOps-related tasks
      • Experience with OMOP CDM, OHDSI ATLAS and other tools, methods and standards developed by OHDSI community

    What we offer

    • An attractive work/life balance (40 hours per week)
      • Comfortable office with all amenities
      • Official employment in accordance with the local legislation
      • Competitive salary
      • Paid vacation and sick leave
      • Free language courses