<- all projects
Data architect VDK Group
the organization
With 150+ installation companies, over 7000 professionals and more than 2 billion euro in revenue, the VDK Group is one of the largest players in the European installation industry, active in six countries and growing fast through acquisitions.
the assignment
As data architect I am responsible for the entire data chain and the central data platform of the group. I designed the platform and actively build on it: a lakehouse on Azure Databricks that processes data from more than 150 companies every night, from 80 sources spread across 20 different source systems. Scalability and reliability come first, as the group keeps growing and the data chain grows with it.
what I did
- Designed the architecture of the full data chain and the Azure infrastructure: medallion on Databricks with Unity Catalog and CI/CD through Databricks Asset Bundles
- Scalable ingestion in Python from ERP, project and accounting packages through a uniform loading pattern, so new acquisitions connect quickly
- Hundreds of dbt models with tests, run automatically and reliably every night
- Releases through Azure DevOps with a development, acceptance and production lane
- Responsible for sprint planning and coordination of the development team, aligning directly with C-level on roadmap and priorities
stack
DatabricksdbtPythonSQLAzureAzure DevOps