Azure Data Engineer

Key Responsibilities:

• Leadership & Team Management:

◦ Oversee the development, testing, and implementation of complex data solutions, ensuring the team meets project timelines and objectives.

• Solution Design & Architecture:

◦ Design and implement robust, scalable, and high-performance data solutions on the Microsoft Azure platform.

◦ Define data architecture strategies to support business requirements and align with cloud-native principles.

◦ Collaborate with business analysts, stakeholders, and IT teams to define data requirements and translate them into technical solutions.

◦ Provide architectural guidance for data pipelines, data lakes, and data warehousing solutions, ensuring they are designed for scalability, reliability, and security.

• Data Modeling & Data Integration:

◦ Develop and maintain logical and physical data models for transactional, analytical, and operational systems.

◦ Ensure consistency, quality, and performance of the data models, optimizing them for Azure-based data storage and processing.

◦ Lead data integration efforts, ensuring seamless integration of on-premises and cloud-based data sources, including both structured and unstructured data.

◦ Work with data engineering teams to implement data transformation processes using Azure Data Factory, Azure Databricks, or other data tools.

• Data Governance & Security:

◦ Establish and enforce data governance practices, including data quality, data privacy, and compliance.

◦ Implement security best practices for handling sensitive data in cloud environments, ensuring the safety of the data throughout the lifecycle.

• Collaboration & Stakeholder Management:

◦ Serve as a technical expert for data-related questions, providing thought leadership to both technical and non-technical stakeholders.

◦ Communicate complex technical concepts in a clear and actionable manner to stakeholders and executives.

Required Skills and Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field, or equivalent experience.

• 7+ years of experience in data engineering, solution design, and data modeling, with at least 3 years focused on Azure data services.

• Strong experience with Microsoft Azure services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake, and Azure Databricks.

• Expertise in designing data models for both transactional and analytical data systems, with a deep understanding of star schema, snowflake schema, and normalization techniques.

• Solid experience with ETL development, data pipelines, and data integration processes.

• Advanced knowledge of SQL and other data processing languages (e.g., Python, Scala, or Spark).

• Familiarity with Azure DevOps, version control, and CI/CD practices for data engineering solutions.

• Strong understanding of cloud security, data governance, and compliance practices.

Preferred Qualifications:

• Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Azure Solutions Architect Expert.

• Experience with Power BI for data visualization and reporting.

• Expertise in big data technologies like Hadoop, Spark, or Kafka in an Azure environment.

• Knowledge of machine learning models and integration with Azure Machine Learning or Databricks.

• Strong problem-solving skills and the ability to innovate and drive solutions in complex, large-scale environments.