Azure Data Engineer

Senior Azure Data Engineer & Test Engineer, Responsible for data engineering/ingestion, testing Data Pipelines, build frameworks using tech stack PySpark, ADF, Synapse, Azure Data Lake, Sql Server, DevOps etc. Good to have Kubernetes, Azure Service Fabric, Delta Lake, Informatica, SSIS, Sql Server etc., Should be ready to pitch in for Data Analysis and provide Solution architecture on demand. Should document all the work and provide pipeline demo, UAT support and Production deployment.

What are the top 5-10 responsibilities for this position? (Please be detailed as to what the candidate is expected to do or complete on a daily basis)

- Responsible for designing, developing, testing, operating and maintaining products

- Takes full stack ownership by consistently writing production-ready and testable code

- Consistently creates optimal design adhering to architectural best practices; considers scalability, reliability and performance of systems/contexts affected when defining technical designs

- Performs analysis on failures, propose design changes, and encourage operational improvements

- Makes sound design/coding decisions keeping customer experience in the forefront

- Takes feedback from code review and apply changes to meet standards

- Conducts code reviews to provide guidance on engineering best practices and compliance with development procedures

- Accountable for ensuring all aspects of product development follow compliance and security best practices

- Exhibits relentless focus in software reliability engineering standards embedded into development standards

- Embraces emerging technology opportunities and contributes to the best practices in support of the bank’s technology transformation

- Contributes to a culture of innovation, collaboration and continuous improvement

- Reviews tasks critically and ensures they are appropriately prioritized and sized for incremental delivery; anticipates and communicates blockers and delays before they require escalation