Beschreibung
Big Data/Hadoop - Data Engineer (m/f/d)
Reference: -en
Start: asap
Duration: 6 MM++
Main tasks:
- Responsibility for Data Integration Pipelines
- Designing solutions based on the business demand and project requirements for Enterprise Data Use Cases
- Developing, maintaining and testing Data Ingestion solutions “bottom-up” from source (e.g. legacy / mainframe / near real time) to target (files / interfaces / Data marts)
- Implementing and integrating ETL workflows (Talend Data Fabric, NiFi, ...)
- Implementing Change Data Capture pipelines enabling using real time data feeds
- Supporting the team in building-up large-scale data processing systems and complex big data projects
- Building data processing systems in Hadoop, Spark and Hive (Cloudera Data Platform)
- Understanding how to apply technologies to solve big data problems and contribute to the design of Enterprise Data Use Cases
- Contributing to Data Governance in terms of enabling Data Lineage, Data Cataloging and Data Modeling
- Focussing on collecting, parsing, managing, analyzing and visualizing large sets of data coming from heterogeneous domains
Main qualifications
- Proficiency with Big Data Hadoop/Spark/Hive/HBase ecosystems such as Cloudera / Hortonworks is a must
- Experience with Data Modeling
- Knowledge in BI & Analytics Platforms, Reporting
- Knowledge in tools for Data Governance and Data Cataloging (.e.g Apache Atlas / Cloudera Navigator) preferred
- Excellent knowledge in Java
- Good communication skills in German & English (OR excellent English only)
Main advantages:
- Working in a highly motivated interdisciplinary team with different Business stakeholders, Architects, Data Engineers, and Data Scientists from both Business and IT
- Working with state-of-the-art technologies
About us:
IT specialists hold all the cards: for its customers in industry and the public sector, Hays is looking for motivated employees who like looking at the bigger picture and growing with new challenges. We make sure that you benefit from our many years of experience in IT recruitment and will find you the right role to suit your skills and interests – all completely free of charge to you. Register with us and reap the benefits of job offers that are both interesting and relevant to your skills and experience.
My contact at Hays:
My contact person:
Marie-Sophie Lendway
Referencenumber:
Make contact:
Phone:
Email: