Lead data Engineer

Key Responsibilities 

• Lead the design, development, and implementation of scalable data pipelines and architectures to support business intelligence, analytics, and machine learning initiatives. 

• Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to ensure seamless data integration and accessibility. 

• Optimize and maintain ETL/ELT processes to improve data reliability, efficiency, and scalability. 

• Ensure data governance, security, and compliance with industry standards and best 

practices. 

• Mentor and guide junior data engineers, fostering a culture of continuous learning and technical excellence. 

• Troubleshoot and resolve data-related issues while ensuring system stability and performance. 

• Manage day to day work assignments, project deliverables and stakeholder communications.  

• Stay up to date with emerging data technologies and recommend innovative solutions to enhance data infrastructure. 

Required Skills & Qualifications 

• Education: Master's degree in Computer Science or a related discipline.  

• Experience: 

o 7 – 10 years of experience in data engineering, with at least 2 years in the healthcare domain. 

o Ability to work in cross-functional teams.  

• Technical Expertise: 

o 7+ years of experience in data engineering with expertise in designing and building large-scale data architectures. 

o Strong proficiency in SQL, Python, and Spark for data processing and transformation. 

o Hands-on experience with cloud platforms (AWS, Azure, or GCP) and cloud-native data solutions. 

o Deep knowledge of ETL/ELT pipelines, data warehousing concepts, and real-time data streaming. 

o Experience with big data technologies such as Hadoop, Apache Kafka, or Snowflake. 

o Strong understanding of data modelling, database optimization, and performance tuning. 

o Knowledge of CI/CD pipelines and DevOps practices for data infrastructure 

• Healthcare Domain Knowledge: 

o Familiarity with Electronic Health Records (EHR), wearable devices, and sensor data. 

o Knowledge of healthcare data compliance (e.g., HIPAA, GDPR). 

• Soft Skills: 

o Strong analytical and problem-solving abilities. 

o Excellent communication skills to present findings to non-technical stakeholders. 

o A collaborative mindset to work with interdisciplinary teams