Azure Data Engineer

Job Role:

We are seeking a skilled Azure Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. This role requires a deep understanding of data architecture, data modeling, and ETL processes. The Azure Data Engineer will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure supports business goals and delivers high-quality data solutions.

Roles & Responsibilities:

Design and implement scalable data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other Azure services.
Develop and maintain data models, data warehouses, and data lakes on Azure.
Collaborate with cross-functional teams to define data requirements and develop solutions that meet business needs.
Optimize data storage and retrieval for performance and scalability.
Monitor and troubleshoot data pipelines and workflows to ensure data quality and reliability.
Implement data governance and security measures to protect sensitive data.
Stay current with industry trends and best practices in data engineering and Azure technologies.
Document data processes, architecture, and data flows for compliance and knowledge sharing.

Experience Required:

Building and optimizing data pipelines
Conducting SQL transformations and ETL processes
Coding in Python and Scala within Azure Databricks
Extracting data from multiple sources, such as applications and APIs
Loading and managing data within Azure SQL Database
Proficiency with Azure Data Factory, Data Lake, and Databricks
Implementing and managing data security measures
Troubleshooting and optimizing data integration processes
Supporting scalable data architecture and analytics solutions