Description

Job Description:

  • Design and develop scalable data pipelines using modern data stack technologies for Pershing X’s Cloud data platform.
  • Write ETL processes, design data applications and develop data pipelines for Operational Business Intelligence Mart
  • Role involves analyzing technical metadata, Data Pipeline logs and data lineage for data platform, and providing insights to support data platform operational decisions.
  • Collaborate with cross-functional teams to understand and Elucidate Observability requirements for the data platform considering SLA, operational needs, DQ and proactive monitoring.
  • Work with other engineers on the team to elevate technology and consistently apply best practices.

 

Required Skill and Experience:

A minimum of five (5) years of IT experience in data engineering or data management field

4 - 5 years of experience in application development using SQL, PLSQL

Strong working knowledge and min of 2 years’ experience in DBT, Snowflake

Recent experience as a Senior Data Engineer in any public cloud, preferably on Azure as well as on a cloud warehouse like Snowflake is required

2+ years of experience in building data pipelines using various ETL and ELT tools

Hands-on experience with Airflow is highly preferred

Experience in building cloud native solutions, preferably on Azure including the use of DevOps CI / CD tools and containers.

Proven experience as a Data Analyst or in a similar role.

  •        Strong proficiency in Data Modelling, process metadata, observability, and monitoring data platforms.

Familiarity with data modelling tools / techniques is a plus

Azure or Snowflake training / certification is a plus

Strong analytical, problem solving, communication, collaborative and organizational skills

Self-driven, self-directed, passionate analytical and focused on delivering the right results

Key Skills
Education

Any Graduate

Back To Jobs