Azure Data Engineer

Responsibilities:
Understand business requirements.
Understand source systems, source data, and formats available on-prem / cloud.
Design and build data ingestion pipeline.
Design and build complex data processing pipelines.
Work with relevant stakeholders to assist with data-related technical issues and support their data needs.
Build programs for data quality checks.
Provide operational support.
Work with data architecture, data governance and data analytics. teams to ensure pipelines adhere to enterprise standards, usability, and performance.
Involve in System Testing, UAT, code deployment activities.
Coordinate with offshore team on regular basis 

Primary Skills: 
Azure Databricks, PySpark, Python, Kafka
Secondary Skills:
ADF, CICD, Airflow, SQL, Cloud Databases
Understanding of Agile methodologies