Data Engineer DataKitchen
Wat betekent dit voor jou?
.
DataEngineer
Albert Heijn isa renowned supermarket chain that has been serving customers acrossthe Netherlands for over 135 years. Founded in 1887 by AlbertHeijn, the company has grown to become one of the most trusted andbeloved grocery retailers in the country. With a commitment toquality, convenience, and customer satisfaction, Albert Heijn hasbecome an integral part of the Dutch community's dailylives.
Albert Heijn isaccelerating in becoming a Food and Tech Company. That is where AHTechnology comes into the picture. With a focus on Data, Digitaland Tech, we at Albert Heijn strive to deliver high qualityproducts where technology plays an importantrole.
JobDescription
Part of AHTechnology is the Data Differentiation Platform (DDP), where wesupport the Cloud Services and Data Management within Albert Heijnand deliver THE groundbreaking self-service data platform, calledThor, designed to empower Data Producers and DataConsumers.
With Thor, theprocess of data ingestion, transformation, and utilization becomesseamless, enabling users to unlock the full potential of their datawhile ensuring compliance with privacy regulations, includinghandling sensitive information like PII (Personally IdentifiableInformation).
Till now, teamswithin DDP have been ingesting the data of the Data Producers intothe data platform, supporting the Data Consumers with accessing thedata and even creating datasets for them. This is changing in thecoming months, where we move towards our new Data Strategy. So,what is the change you mightthink?
Well, as statedThor is designed to empower Data Producers and Data Consumers,meaning that Data Producers can onboard their own data in aSelf-Service manner, without having a dedicated team within DDPdoing this for them. This makes the data flow easier, where a DataConsumers requests the data to the Data Producers, and they ensureit's delivered forthem.
Besidesensuring that data ingestion gets easier, DDP is also working onvarious enablement blocks on the data platform, to make the life ofour Consumers easier when it comes to data preparation for dataproducts they work on. You can think of having a standardizedpackage that builds up a DataMart in a few clicks. It is not thereyet but soon tocome!
So, what willbe yourjob…
We are lookingfor Data Engineer who can help with the creation of our so calledDataKitchen. An inhouse self-built engine for creating DataMartsand datasets on top of our self-service data platformThor.
You as a dataengineer will join a team of Data Engineers that has been exploringall the options there are in the market concerning the creation ofaDataMart.
We have varioustypes of Stakeholders, such as Data Analyst, Data Scientists butalso PowerBI users.
Our aim is to create a DataMartengine which can be deployed across the organization, allowingconsumers to have data modelled like they were used to in our oldData Warehouse calledPallas.
We finishedtesting our first two PoC’s earlier this year, which was a success!The DataMart engine is now being worked on to go to Production bythe end of quarter 2, 2024 and many use cases are waiting for thistohappen.
To be able toscale, add additional features and support our DataMart Engine, weneed to grow our team. Ensuring we have a stable and mature teamthat can work towards the future, having our DataKitchen being usedin all brands across Europe and maybe evenbeyond!
That is why weneedyou!
KeyResponsibilities
- Work closelytogether with the DataKitchen Data Engineers in expanding thefoundation for the DataMartEngine
- Support theProduct Owner with stakeholdermanagement
- Ensure theDataMart is being built in such manner that it’s a (versioned)package we can deliver, as we won’t be owning theDataMart.
- Train others inmaking right usage of DataMartengine
- Ensurealignment with architecture and data strategy is there at alltimes
- Keep buildingthe product in a scalable and cost effectivemanner
- Ensure theproduct meets all securityguidelines
- Implementobservability with proactivemonitoring/alerting
- Changes ofDataKitchen engine version made available via pull mechanism.
Requirements
- >7 years’ work experience as aDataEngineer
- Experience with Cloud platforms(MicrosoftAzure)
- Experienced withDatabricks
- Very experienced withPython/SQL/PySpark
- Experienced in running bigger projectsand scalingthem
- Understanding concepts of DataModelling, Orchestration andObservability
- Strong communication and teamworkskills, with the ability to effectively collaborate with bothtechnical and non-technicalstakeholders
- Lives in Netherlands and can work fromZaandam office minimum 2 days a week, more ifrequired
What weoffer
At Albert Heijn we aim to grow, and thisis only possible if you grow along with us. As we work together tobuild our brand and your career, you can count on (based on 40hours perweek):
- An annual salary up to 95k includingholiday allowance and a flexible bonus. Depending on your level of seniority andexperience;
- A minimum of 20 days paid vacation,optionally 12.5 days extra. Do you want to take that extra timeoff, or would you rather convert the extra days into discounts orsell them for cash? You’re the endboss!;
- Flexible workinghours;
- Access to a challenging trainingcurriculum – AH TechAcademy;
- An excellent pension plan where we as anemployer contribute 6 times more than you as anemployee;
- A travel allowance or a NS-business cardfor traveling to and from Zaandam bytrain;
- 10% staff discount on groceries in allAlbert Heijn stores, to a maximum of €300 peryear;
- A free Mijn Albert Heijn Premiummembership with manybenefits;
- A company laptop andtelephone.
Ready to contribute to ourmission?
Do you want to play an active role inchanging the food retail landscape as we know it? Then hop on boardand join us on our expedition. Would you like to learn more first,before you apply to Albert Heijn? We’re happy to tell youeverything about this vacancy! An assessment might be part of ourselectionprocess.
.