Lead Data Engineer
DL Remote is a talent network for remote-ready or relocation-supported jobs at outstanding companies. We help you find a good match.
Hamburg | Relocation Package
We are currently staffing a permanent, Lead Data Engineer role @ a leading energy solutions company in Hamburg.
In this role, you will join the Analytics & AI team. As part of this team, you will oversee the development and management of sophisticated data processing systems in the data platform on Azure Cloud. This role involves advancing data solutions on Databricks, optimizing data acquisition via Azure Data Factory, Logic Apps, Azure Functions, Spark and ensuring quality assurance for data pipelines.
You should have 5+ years of experience in Data Engineering, some (lateral) team leadership, and in-depth Azure Data Data Factory & Databricks experience.
Furthermore, you should have high-level Python and SQL skills and a comprehensive understanding of Big Data technologies like Hadoop, Spark or related distributed computing frameworks.
| REMOTE SETUP
This hybrid remote role is based in Hamburg (~2 days/ week in office). Potential relocation or travel costs will be covered.
| ABOUT THE ROLE
In this role, you will work on the following topics:
* Technical Leadership and Best Practices
Provide strong technical leadership and guidance to a team of data engineers, ensuring adherence to best practices in data engineering, cloud computing, and data security.
* Streamlining Data Acquisition
Optimize data acquisition processes using Azure Data Factory, Logic Apps, and Azure Functions to improve efficiency and accuracy.
* Quality Assurance
Implement robust validation, error handling, and performance consistency across various data sources and processes to ensure the highest quality of data pipelines.
* Scalability and Performance
Oversee and enhance the scalability of data processing systems, ensuring they can manage increasing data volumes and complex processing needs while maintaining high performance.
* Cost Optimization
Continuously monitor and optimize cloud resource usage and expenses, implementing cost-effective solutions without compromising performance and scalability.
* Automation and CI/CD
Implement and maintain continuous integration and deployment (CI/CD) practices for data pipelines to improve efficiency, reduce manual errors, and accelerate deployment processes.
| WHAT YOU WILL GET
* Lead, coach and grow a team of Data Engineers to develop and optimize an industry-leading data platform, which helps to improve the efficiency within different segments of the energy value chain
* Salary of up to 105k€ / yearÂ
* Company Pension scheme (+~6% yearly salary) and extensive health and wellbeing-focused list of perks (i.e. 38-hour work week, 30+6 days vacation, nanny support, jobrad, ...)
* 1.300€ extra holiday payment
* Hybrid Remote setup & a strong focus on individual flexibility
| NEXT STEPS
If you are interested in this role, we will share additional information about the company and position to support your decision-making process and invite you to a first chat with the head of engineering.