19.10.2026 aktualisiert

**** ******** ****
verifiziert
Premiumkunde
100 % verfügbar

Senior Cloud/Data Engineer

Bussum, Niederlande
Nur Remote
Bacheloriat Degree (MBO + HBO) Scientific Specification
Bussum, Niederlande
Nur Remote
Bacheloriat Degree (MBO + HBO) Scientific Specification

Profilanlagen

Profile.pdf

Über mich

27yo. Honest, willful, ambitious. Going the extra mile is my normal modus operandi. I simplify all your overengineered and overcomplicated data processes into something modular and scalable, I teach teams to do this too.

Skills

dbtC (Programmiersprache)Amazon Web ServicesCloud ComputingData ArchitectureDistributed ComputingHypertext Transfer Protocol SecurePythonPostgreSQLRedisAzure Active DirectorySQLTCP / IPApache SparkKotlinApache KafkaSpark StreamingApi-GatewayTerraformgRPCSql Database AdministrationGolangMicroservices
Senior Data & Backend Engineer with 7+ years building data platforms and distributed systems that run in production, not just on slides. I take slow, fragile or overengineered processes and turn them into something modular, fast and maintainable.

Results I can back up: helped cut processing of 3.5M smart-meter readings from 2 days to 5–10 minutes (Essent); rewrote Glue pipelines from 34 to ~2 minutes; redesigned a Go service at Schiphol with hash rings and gossip, cutting 100+ pods to 8 in the worst cases; built a geo-redundant Kafka cluster across 4 POPs handling 6.5M documents every 5 minutes.

Core stack: Go, Kotlin/Spring Boot, Python, SQL · Kafka (CCDAK certified), Snowflake, dbt, Polars, Spark · AWS (Lambda, Step Functions, ECS, MSK, Glue), Azure · Terraform, Docker, Kubernetes, Linux.

Working solo, I own the problem end to end: from first conversation to production, including IaC, CI/CD, tests and documentation. In a team, I've led groups of 3–4 engineers, acted as technical point of contact for stakeholders, and mentored developers from bootcamp graduates to mediors.

I don't let problems go. When a TLS fault at Schiphol cut success rates by 30–40%, I gathered hard proof, pushed it across teams for months and saw metrics back at 98–100%. I say what I think, back it with evidence and deliver what I commit to.
Languages: English, Spanish, Catalan (native), Dutch (basic).

Erfahrung

Berufserfahrung5 - 10 Jahre
Freelancer seit2024

Sprachen

EnglishMutterspracheDutchGrundkenntnisseSpanishMuttersprache

Projekthistorie

Senior Data Engineer (Freelance)

Melotech Inc.

Internet und Informationstechnologie

10-50 Mitarbeiter

- Reduced the main codebase by 26.000+ lines of code (literally), migrated code to new SQL Model, got rid of tech debt and unused features.
- Parallelised configuration and authentication fetches in Python after transforming main application to a service rather than a finite process
- Made base IAC repository for AWS infrastructure
- Refactored data flow process from scheduled ETL to eventing architecture

Senior Data Engineer

Schiphol B.V

Transport und Logistik

>10.000 Mitarbeiter

- Developed a high availability custom piece of software for our VM Software based on Redis distributed locks and a custom docker service that lets us use Redis via HTTPS URL commands (safe ones, no custom scripting). This guaranteed a high availability (non distributed) pattern for our Software application.

- Co developed (server side) remote configuration system our main software, the software is hosted on client premises thus access both on network and permissions level is very limited. We implemented a feature so the software can detect configuration changes and pull them when necessary. This saved a lot of time since there are over 20 VMs each one with different authentication / VPN / Connectivity requirements.

- Refactored Stacking service to a distributed service with automated re distribution of configuration via HashRings for all pods and automated cluster behaviour set up with Gossip protocol. This reduced the pod needs from 1 pod per "url" to 1 pod per 20 urls, eseentially making the cluster x20 more efficient. In severe cases it reduced 100+ pod uses to 8.

Senior Data Engineer

Essent

Energie, Wasser und Umwelt

5000-10.000 Mitarbeiter

- Lead Developer in the Individual Smart Meter Allocation process, Grid Sages Team, with which teams can shoot in requests to turn on Smart Allocation on a Meter due to contractual reasons and the platform will take care of the rest such as tracking state and reporting back successes or failures (VPC, ECS, Kotlin, SpringBoot, Confluent Kakfa, MSK, Cloudwatch).

- Changed the standard on testing processes to adhere (as much as possible) to Embedded libraries for testing (rather than test containers or other docker based solutions), this removed complexity from our pipelines and in our local / CI testing setup it provided a database with the exact version we run in our remote enviornments while incurring in 0 tech debt.

- Lead Engineer in a team of 4 in charge of designing, developing and deploying a new platform: Connection Management. This platform takes care of ingesting Customer Data (such as Contract Data, Technical Data on Electricity / Gas Meters among other sources) storing it and sending payloads to a multitude of processes that need this data to operate on a daily basis.

- Lead Data Engineer of a team of 3 people collaborating with Data Science team. Managed communication with stakeholders, technical priorities and discussions. Our team delivered a solution that reduced processing time by 10h / day on average and reduced the usage of Glue/Spark to a bare minimum.

Lead Developer

Vertical Studio

Internet und Informationstechnologie

10-50 Mitarbeiter

- Developed (pair) the integration for service to interact with BlackRock foundational models and the storage / tracking of metadata (token usage) for each user request recieved via DynamoDB.

- Developing a Terraform based repository that deploys VLLM instances in ECS Managed Auto Scaled EC2 Groups. This is an IAC first approach to having our own hosted models and it enables the possibility for other automated processes to add Models we want to host dynamically so that they can be deployed with their auto scaling parameters automatically via Terraform. (VLLM, S3, Terraform, Github Actions, ECS, EC2, Cloudwatch, Cuda)

- Developed a process capable of spawning proxies hosted in ECS which use NGINX and leverage docker multi stage builds to include domain certificates. These certificates enable HTTPS communication between Vertical and external Parties. This was done to enable a fully scalable system where each externally hosted model communicates via HTTPs with us. (NGINX, ALB, ECS, Boto3, asyncio, Python, Docker)

- Developed a POC based on Llamafactory to provide a unified framework that can run fine tuning and inference sessions with ad hoc configurations. (Python, Llamafactory, VLLM, S3, QLora, Lora, Qwen, OLlama)

- Participated in technical discussions with Vertical Studio's Partners (Akash, Edge)

Data Engineer

iVent Mobile

Internet und Informationstechnologie

10-50 Mitarbeiter

- Deployed a GEO Redundant Kafka Cluster (8 nodes) in 4 POPs around the world, set up MM2 redundancy for real time data streaming. This cluster supports data from over 2500 customer planes, around 6.5 million documents every 5 minutes. (Kafka, Centos7)

- Set up and maintained a 9 node Galera cluster and proxySQL for Observium (NMS System). This system is now in charge of monitoring over 2500 VMs in 4 different data centers in the world and provides critical status updates to hundreds of support engineers. (PostgreSQL, Observium, ProxySQL, MariaDB, Galera)

- Worked on data parsing, processing, analyzing, and visualizing. Created and combined several internal and external data sources to enrich our client's datasets. (Ruby, Rails, ElasticSearch, Kibana, PostgreSQL, Kafka).

- Designed and implemented a Data Model capable of supporting multiple Mobile Technologies and their metadata, regardless of source and data structure. This cut implementation times by over 4 hours per each Technology and standarized all sources. (PostgreSQL, Rails)

- Designed and developed a Geo Redundancy and Fail Over system for Delayed Jobs, this made all our data processors redundant and fail safe. It also allowed us to have 4 hosts with Delayed Jobs workers in 4 locations around the world. (Ruby, PostgreSQL, Rails)

Data Engineer

Annual Insight

50-250 Mitarbeiter

- Developed 8+ data crawlers that track several public data sources, these fetched financial statements for hundreds of companies, making the Analysts have the latest reports on any company they were analyzed at the time. (MSQL, SSMS, Python, Docker, Selenium)

- Developed a new Data Model for the Annual Insight's data platform, and took care of developing the necessary ETLs for that to happen. The model allowed for increased speeds when enriching data. (MSQL, SSMS, Python)

- Created a PDF Parser with Python which read through crawled financial statements and saved the metrics read. These were then corrected or approved by analysts. The PDF Parser application saved about 4 hours of manual input for every analyst and every company they analyzed. (Python, OCR)

- Designed, developed, and implemented an SDK for the company to use, the tools it included were: A generic Logging system that fed the monitoring dashboards with continuous statuses from every application, and, a Python Implementation of Azure AD for any of our applications to log in to Annual Insight's Key Vault and Secret Vault automatically. (Python, Azure SDK)

- Designed and implemented testing and CI/CD with Azure DevOps. (Azure, Docker, Selenium)

- Taught several Pythonic standards to the team in order to bring flexibility and reduce duplication and code debt.

Kontaktanfrage

Einloggen & anfragen.

Das Kontaktformular ist nur für eingeloggte Nutzer verfügbar.

RegistrierenAnmelden