Azure– Data Engineering Lead

Job Purpose:

• To lead the Azure Data Engineering tracks of Bank’s Data Office.
• Should take end to end ownership of bringing the data from different source system and creating models on top of it for end user consumption.

Experience

Overall experience between 10 to 15 years, applicant must have minimum 7- 10 years of hard core professional experience in using the Azure Data engineer using azure services

Technical Skills

• Strong foundation in software engineering principles and an architectural mindset.
• Knowledge of Big Data technologies, such as Spark
• Experience in architecting software solution on public cloud like Azure
• Well versed with Azure services like databricks, data factory, cosmos DB, azure functions, Synapse
• Experience in authoring or reviewing system design documents for enterprise solutions.
• knowledge of testing frameworks and libraries.
• Working knowledge of the pros, cons and usages of various azure services
• Experience of working in Agile delivery
• Good knowledge of database management languages e.g. SQL, pyspark SQL.
• Experience in data hygiene procedures, identity resolution capabilities or data management a plus
• Familiarity with industry best practices for collection and use of data

Responsibility

• Work closely with the Product Owners and stake holders to design the Technical Architecture for data platform to meet the requirements of the proposed solution.
• Work with the leadership to set the standards for software engineering practices within the machine learning engineering team and support across other disciplines
• Play an active role in leading team meetings and workshops with business units.
• Choose and use the right analytical libraries, programming languages, and frameworks for each task.
• Help the Data Engineering team produce high-quality code that allows us to put solutions into production
• Create and own the technical product backlogs for products, help the team to close the backlogs in right time.
• Refactor code into reusable libraries, APIs, and tools.
• Help us to shape the next generation of our products.

Qualifications

• Bachelors of Computer Science or Equivalent
• Should have certification done on Microsoft Data Engineer Expert certification (AZ400 and DP200)

Behavioral Competencies

• Natural leadership skills
• Should have excellent problem-solving and time management skills
• Strong analytical ability
• Applicant should have excellent communication skill
• Process oriented with flexible execution mindset.
• Clear and demonstrative communication
• Efficient problem solving skills
• Identify, track and escalate risks in a timely manner