Description

Key Responsibilities

 

As Data Engineering lead, you will have the following responsibilities:


•    Lead clients discussions going from defining the problem, Advising on the solution (Data Architecture, Best practices guidance) and supporting implementation.
•    Lead the design, development, and maintenance of efficient data pipelines.
•    Create robust data products that leverage cloud Data platforms such Azure Synapse, Snowflake and Databricks
•    Use cloud services to build scalable, reliable, and efficient data solutions.
•    Help translate data and analytics requirements into data solutions based on the approved technical designs. 
•    Define the technology stack, best practices, and standards for data engineering and analytics.
•    Enable test automation and ensure CI/CD pipelines are in good health. 
•    Implement monitoring of data applications and track product quality, performance, and stability. 
•    Carry out effective technical design reviews to ensure that the right architecture patterns are used by the team.
•    Optimize and fine-tune data processing workflows for performance and reliability.
•    Identify and resolve issues within organizations and processes.
•    Educate clients and partners about the data analytics landscape.
•    Provide guidance on industry trends, emerging technologies, and best practices.
•    Lead a team of Data Engineers to thrive by promoting teamwork, providing guidance, and encouraging skill enhancement.

 

Skills and Attributes for Success

 

•    Master’s degree in computer science, engineering, mathematics or another relevant subject
•    Minimum 5+ years’ experience in Data Engineering
•    Experience with batch and real-time processing frameworks. 
•    Expertise in proactive performance monitoring, conducting data quality testing, and troubleshooting performance issues of complex warehouse data tables. 
•    Experience in assembling data from multiple sources and analyzing and modeling complex datasets.
•    Hands-on Experience with production Cloud / DevOps environments and Data Lake, Data transformation, ETL/ELT, and other data concepts 
•    Practical knowledge of cloud possibilities and limitations in areas like distributed systems, load balancing, networking, massive data storage, and security.
•    Solid Experience of leveraging Microsoft Azure ecosystem to manage the development and maintenance of cloud platform operations.
•    Understanding of data architecture concepts such as data modeling, Big Data storage, Lambda architecture, data vault, and dimensional modeling, Data Fabric and Data Mesh is nice to have.
•    Excellent analytical skills and problem solver
•    Strong communicator who understands team dynamics, able to support where needed and lead when asked.
•    Experience in leading and coaching technical teams.
•    Fluent in Dutch and/or French, proficient business English

Education

Master’s degree in computer science, engineering