Description

As a Data Engineer, you will be working on a number of high-profile projects and collaborating with key partners to design and build solutions that enable the business to gain insights needed for decision-making. You will be instrumental in our digital transformation by building the foundations for our cloud solutions and providing enterprise solutions to common problems. Projects will focus mainly on new development in the areas of data discovery, data quality, data integration and data movement.

 

Responsibilities

  • Experience in Data Warehousing & Redshift /Snowflake Computing platform
  • Experience in AWS Glue for Creating the Ingestion process
  • Experience on Python for Lambda fuction, exp on ETL process using Python, and Nummy and Pandas libraries exp.
  • Exp in Data Pipeline, Stepefunction and EMR
  • Experience working on migrating data from on premise (RDBMS, Hadoop, Netezza) data lake to Cloud – AWS, Redshift/Snowflake
  • Experience working on different source data - RDBMS, Flat files, XML, JSON
  • Expertise in SQL, especially within cloud-based data warehouses like Redshift or Snowflake
  • Strong understanding of ETL concepts and work experience in AWS Glue
  • Proven analytical and problem-solving skills
  • Exp in Python, Spark
  • Exp in Kubernetes and Docker
  • Exp in Orchestration process using Argo
  • Ability to work independently and on multiple tasks/initiatives with multiple deadlines
  • Effective oral, presentation, and written communication skills
  • Data modelling and data integration
  • Support/Troubleshooting

 

Qualifications/Minimum qualifications

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, related fields
  • Hands on experience with Snowflake
  • Snowflake setup
  • SnowSQL Development

Snowflake Certification / AWS Certification / Azure Certification preferred-Good to have

 

Preferred Qualifications

  • Hands on experience in python & related frameworks on Linux environment
  • Experience with Snowflake , SnowSQL
  • The ability and desire to learn and adapt in complex work environment
  • Outstanding communication and critical thinking skills
  • Good analytical and problem solving skills and ability to balance team and client discussions

Education

Any Gradute