Sr. Data Engineer

Job description:

Key Responsibilities:

• Design, develop, and maintain data pipelines within Azure/ Microsoft SQL experience to support data integration and analysis.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Implement data transformation and enrichment processes to ensure data quality and consistency.
• Optimize performance of data workflows and troubleshoot issues as they arise.
• Develop and maintain documentation for data processes and workflows.
• Stay updated with the latest features and best practices in Azure/ Microsoft SQL to continuously improve data solutions
• Data Pipeline Development: Scalable Pipelines, ETL Processes, Automation
• Data Storage and Management: Data Warehousing, Database Optimization, Version Control
• Performance Optimization and Scaling: Efficient Data Handling, Distributed Computing
• Data Security and Privacy: Data Anonymization, Compliance with Regulations
• Documentation and Reporting: Data Pipeline Documentation, Reporting

Key Responsibilities & Skillsets:

• 9+ years of relevant experience in data engineering tools
• Data Tools: SSIS, Microsoft SQL, Azure , AWS S3
• Version Control & Collaboration: Git/ Any other version control software
• Excellent communication & presentation skills and should be able to communicate with client effectively
• Experience in managing SQL codes and collaborating with customer on data model evolution
• Good knowledge of Relational Data Base Management and SQL
• Strong SQL and Python

Candidate Profile:

• Bachelor’s/Master's degree in economics, mathematics, actuarial sciences, computer science/engineering, operations research or related analytics areas; candidates with BA/BS degrees in the same fields from the top tier academic institutions are also welcome to apply
• Strong and in-depth understanding of DE Fundamentals
• Data analysis experience (Preferred)
• Superior analytical and problem solving skills
• Outstanding written and verbal communication skills
• Able to work in fast pace continuously evolving environment and ready to take up uphill challenges