Deutsche Bahn Energie - Data engineer
Deutsche Bahn Energie
(Transport und Logistik, >10.000 Mitarbeiter)
Letztes Update: 15.08.2023
AWS (Step Functions), Gitlab CI/CD, Scala, Spark
Worked on a Big Data project in the automotive domain (end customer – Mercedes Benz), developing tools for vehicle’s test data (datasets in order of 100TBs in size) processing. Additionally worked on the BDSP product used for the said transformations. Refactored monolithic Java codebase into smaller components; fixed unit testing, CI/CD pipelines.
Building ETL pipelines
Kafka, ksqlDB, Kafka Connect, Python, Azure, Kubernetes, Postgres, Oracle