Key Skills: Pentaho, Pentaho Data Integration, Python, ETL, Data Stage,Pyspark, Control M, UNIX, SQL, GCP.
Roles and Responsibilities:
- Communicating effectively with senior stakeholders.
- Work with a team of technologists, ensuring prioritization of tasks and supporting removal of blockers.
- Working on burning the product backlog and oversee product demos.
- Understanding complex business requirements and new technologies and understand how to influence teams to adopt new practices and embrace automation.
- Managing of risks and issues.
Experience Requirement:
- 8-10 years of experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho etc.
- At least 2 years of experience in Pyspark development; should be capable of developing/configuring data pipelines.
- Strong experience in writing complex SQL queries to perform data analysis on databases SQL Server, Oracle, HIVE etc.
- Possess the following technical skills - SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools).
- GCP Cloud knowledge/experience (in Airflow, Dataproc, BigQuery) is an additional advantage.
- Ability to work independently on specialized assignments within the context of project deliverables.
- Take ownership of providing solutions and tools that iteratively increase engineering efficiencies.
- Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of data pipelines.
- Proven problem solving and analytical abilities including the ability to critically evaluate information gathered from multiple sources, reconcile conflicts, decompose high-level information into details and apply sound business and technical domain knowledge.
- Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills - the ability to communicate efficiently at a global level is paramount.
- Ability to deliver materials of the highest quality to management against tight deadlines.
- Ability to work effectively under pressure with competing and rapidly changing priorities.
- Nice to have: Finance systems and language, Data processing and analytics systems.
Education: B.Tech M.Tech (Dual), B.Tech, M. Tech