Key Responsibilities
As Data Engineering lead, you will have the following responsibilities:
• Lead clients discussions going from defining the problem, Advising on the solution (Data Architecture, Best practices guidance) and supporting implementation.
• Lead the design, development, and maintenance of efficient data pipelines.
• Create robust data products that leverage cloud Data platforms such Azure Synapse, Snowflake and Databricks
• Use cloud services to build scalable, reliable, and efficient data solutions.
• Help translate data and analytics requirements into data solutions based on the approved technical designs.
• Define the technology stack, best practices, and standards for data engineering and analytics.
• Enable test automation and ensure CI/CD pipelines are in good health.
• Implement monitoring of data applications and track product quality, performance, and stability.
• Carry out effective technical design reviews to ensure that the right architecture patterns are used by the team.
• Optimize and fine-tune data processing workflows for performance and reliability.
• Identify and resolve issues within organizations and processes.
• Educate clients and partners about the data analytics landscape.
• Provide guidance on industry trends, emerging technologies, and best practices.
• Lead a team of Data Engineers to thrive by promoting teamwork, providing guidance, and encouraging skill enhancement.
Skills and Attributes for Success
• Master’s degree in computer science, engineering, mathematics or another relevant subject
• Minimum 5+ years’ experience in Data Engineering
• Experience with batch and real-time processing frameworks.
• Expertise in proactive performance monitoring, conducting data quality testing, and troubleshooting performance issues of complex warehouse data tables.
• Experience in assembling data from multiple sources and analyzing and modeling complex datasets.
• Hands-on Experience with production Cloud / DevOps environments and Data Lake, Data transformation, ETL/ELT, and other data concepts
• Practical knowledge of cloud possibilities and limitations in areas like distributed systems, load balancing, networking, massive data storage, and security.
• Solid Experience of leveraging Microsoft Azure ecosystem to manage the development and maintenance of cloud platform operations.
• Understanding of data architecture concepts such as data modeling, Big Data storage, Lambda architecture, data vault, and dimensional modeling, Data Fabric and Data Mesh is nice to have.
• Excellent analytical skills and problem solver
• Strong communicator who understands team dynamics, able to support where needed and lead when asked.
• Experience in leading and coaching technical teams.
• Fluent in Dutch and/or French, proficient business English
Master’s degree in computer science, engineering