Key Skills: Azure Data Factory, Azure Data Bricks, PySpark, SQL, ADLS Gen2 Storage, Key Vault, Azure Functions, Azure DevOps, Oracle, MSSQL, Data Warehousing, Data Lake, Delta Tables, Complex Data Architecture, Documentation, Communication Skills, Direct Customer Interaction, Team Leadership.
Roles & Responsibilities:
- Lead the design and implementation of Azure-based data solutions, ensuring optimal performance and scalability.
- Manage and oversee the use of Azure Data Factory, Azure Data Bricks, and Synapse for data integration, transformation, and storage.
- Develop complex PySpark solutions for large-scale data processing and ensure efficient data pipeline management.
- Optimize SQL queries and manage data transformation using Azure Data Lake Storage Gen2.
- Implement and manage Azure Key Vault and Azure Functions to ensure secure and scalable solutions.
- Collaborate with cross-functional teams to define complex data architectures and implement industry best practices.
- Engage directly with customers to understand requirements, ensuring solutions meet their business needs.
- Supervise a team, providing leadership, mentorship, and direction while ensuring timely project delivery.
- Take full ownership of the project and make critical independent decisions regarding data architecture, integration, and transformation strategies.
- Maintain documentation for project processes, architectures, and implementation details.
- Ensure effective communication with stakeholders, both internal and external, ensuring alignment on project goals.
- Lead and manage onsite/offshore models to deliver successful projects, managing timelines and expectations.
Experience Requirements:
- 7 - 10 years of total experience in Azure-based solutions, data engineering, and architecture.
- Experience with Azure Data Factory, Azure Data Bricks, SQL, and ADLS Gen2 Storage.
- Experience with PySpark and data transformation processes.
- Experience with Synapse, Key Vault, Azure Functions, and Azure DevOps.
- Strong experience in Data Warehousing, Data Lake, and Delta Tables concepts.
- Proven experience in direct customer interaction, acting as the primary point of contact for client discussions and requirements.
- Team leadership experience, managing a team, and ensuring alignment with organizational goals.
- Experience in managing and delivering projects in an onsite/offshore model.
- Strong documentation and communication skills to effectively collaborate and convey technical concepts.
Education: Any Graduation