Key Skills: Data Engineering, Data Modelling, Data Analysis, Data Profiling, SQL, ADF/ Snowflake, Power Bi, Investment Management/Investment Banking Domain
Profile Summary
- The purpose of Senior Data Engineer is to develop and enhance data engineering solutions for distribution and sales enablement.
- Create and maintain the analytics ecosystem for integrating data to facilitate reporting and analytics needs for Sales and Distribution Group
- Collaborate with cross-functional teams, including business/data analysts, data scientist, Salesforce technology and business analyst to build robust data pipelines and deliver actionable insights to improve business process.
- Identify, research, and resolve data anomalies to ensure data quality.
Job Responsibility
- Design and implement scalable and efficient data processing pipelines using ADF, Snowflake and SQL
- Develop end-to-end data ingestion and transformation solutions, optimized for performance, scalability and efficiency.
- Work closely with cross-functional teams to integrate Snowflake and Reporting solutions into the overall Data Architecture
- Build an aggregate layer to support reporting and analytical needs for IM business process.
- Write SQL and stored procedures to support dashboarding and analytics.
- Troubleshoot data issues and optimize data pipelines for performance.
- Conduct root cause analysis & corrective measures on defects/issues identified.
- Work closely with analysts and business process owners to translate business requirements into technical solutions.
- Recommend design alternatives, consider benefits and limitations to users based on in-depth understanding of business needs; code very moderate/complex or high-risk components.
- Create and maintain comprehensive documentation on configurations and processes, document best practices and standards.
- Adhere to all organizational and IT policies and processes for software development and project management.
- Keep current on best practices in technology, and marketplace trends (including business competitors and technology vendors)
Requirements and Qualifications
- 4-8 years of industry experience in data engineering, business intelligence field with experience in manipulating, processing, and extracting value from datasets.
- Hands on experience building data pipelines using ADF, Snowflake SQL, stored procedures and relational databases.
- Good knowledge in Data modeling, Data Profiling, Data Analysis, Data Quality
- Strong problem solving and proven data analytical skills.
- Familiarity with BI reporting tools Tableau and Power BI is beneficial.
- A good understanding of cloud technologies and agile methodology is a plus.
- Ability to challenge current methodologies/approaches and develop more efficient and effective data solutions.
- Ability to communicate effectively with Product Owner, Technology team and business stakeholders.
- Excellent verbal & written communication skills with strong interpersonal skills.
Education & Certifications
- Engineering Graduate/MCA in Computer Science/Information Science or Equivalent.
- Snowflake Certification is a plus.
- Must have Good Knowledge of Investment Management domain or Financial Services.