Work with large data sets and implement sophisticated data pipelines with both structured and structured data.
Collaborate with stakeholders to design scalable solutions.
Manage and optimize our internal data pipeline that supports marketing, customer success and data science to name a few.
Maintain awareness of emerging technology in the market and technical industry trends related to the product space and uses the knowledge to contribute to product strategy.
Build continuous integration, test-driven development and production deployment frameworks.
Collaboratively review design, code, test plans and dataset implementation performed by other.
Data engineers in support of maintaining data engineering standards.
Analyze and profile data for designing scalable solutions.
Required Skills
Demonstrated strength in data modelling, data warehousing and SQL.
Excellent hands on working experience on Azure cloud big data platform.
Extensive knowledge with cloud technologies, e.g. AWS and Azure.
Excellent hands on experience on data modelling.
Has a strong problem solving and analytical mindset.
Strong understanding of data structures and algorithms.
Required Experience
5+ years of experience as a Big Data engineering professional, developing scalable big data solutions.
Experience with source control tools such as GitHub and related dev processes.
Experience with agile methodology/Scrum process across geographically distributed teams.
Experience with scripting languages such as Shell, Python.
Experience with relational SQL.
Experience with workflow scheduling tools.
Experience working on end-to-end solution design.
Education Requirements
Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.