Data Engineer

Key Skills: Data Engineer, Python

Roles and Responsibilities:

• Design, build, and maintain robust data pipelines to curate and ingest data efficiently.
• Work with Azure cloud services to deploy and manage scalable data solutions.
• Implement and maintain CI/CD pipelines for seamless data workflows.
• Collaborate with cross-functional teams to ensure data integrity, security, and accessibility.

Skills Required:

• Strong SQL skills.
• Strong programming skills in Python (PySpark).
• Hands-on experience with Azure Data Services (Azure Data Factory, Databricks, Synapse, Data Lakes etc).
• Experience with CI/CD pipelines for release management.
• Experience in database management.
• Knowledge of best practices in data ingestion, transformation, and curation (Dimensional modelling & Medallion schema).

Nice to Have:

• Insurance experience
• Fabric experience
• Purview experience
• Power BI experience

Education: Bachelor's Degree in related field