Description

Responsibilities

  • Work with large data sets and implement sophisticated data pipelines with both structured and structured data.
  • Collaborate with stakeholders to design scalable solutions.
  • Manage and optimize our internal data pipeline that supports marketing, customer success and data science to name a few.
  • Maintain awareness of emerging technology in the market and technical industry trends related to the product space and uses the knowledge to contribute to product strategy.
  • Build continuous integration, test-driven development and production deployment frameworks.
  • Collaboratively review design, code, test plans and dataset implementation performed by other.
  • Data engineers in support of maintaining data engineering standards.
  • Analyze and profile data for designing scalable solutions.

Required Skills

  • Demonstrated strength in data modelling, data warehousing and SQL.
  • Excellent hands on working experience on Azure cloud big data platform.
  • Extensive knowledge with cloud technologies, e.g. AWS and Azure.
  • Excellent hands on experience on data modelling.
  • Has a strong problem solving and analytical mindset.
  • Strong understanding of data structures and algorithms.

Required Experience

  • 5+ years of experience as a Big Data engineering professional, developing scalable big data solutions.
  • Experience with source control tools such as GitHub and related dev processes.
  • Experience with agile methodology/Scrum process across geographically distributed teams.
  • Experience with scripting languages such as Shell, Python.
  • Experience with relational SQL.
  • Experience with workflow scheduling tools.
  • Experience working on end-to-end solution design.

Education Requirements

  • Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.


 

Education

Any Graduate