Azure Data Engineer

Description:

Requirements:

5+ years of experience in an Enterprise Data Management or Data Engineering
role
3+ of hands on experience in building metadata driven data pipelines using
Azure Data Factory, Databricks / Spark for Cloud Datalake
5+ years hands on experience with using one or more of the following for
data analysis and wrangling Databricks, Python / PySpark, Jupyter Notebooks
Expert level SQL knowledge on databases such as but not limited to
Snowflake, Netezza, Oracle, Sql Server, MySQL, Teradata
3+ years of hands on experience on one or more of big data technologies such
as Cloudera Hadoop, Pivotal, Vertica, MapR is a plus 
Experience working in a multi developer environment and hands on experience
in using either azure devops or gitlab
Preferably experienced in SLA driven Production Data Pipeline or Quality
support
Experience or strong understanding of the traditional enterprise ETL
platforms such as IBM Datastage, Informatica, Pentaho, Ab Initio etc.
Functional knowledge of some of the following technologies - Terraform,
Azure CLI, PowerShell, Containerization (Kubernetes, Docker)
Functional knowledge of one or more Reporting tools such as PowerBI,
Tableau, OBIEE
Team player with excellent communication skills, ability to communicate with
the customer directly and able to explain the status of the deliverables in
scrum calls
Ability to implement Agile methodologies and work in an Agile DevOps
environment


Qualifications:

Bachelor’s degree in Computer Science or Engineering or Mathematics or
related field and 5+ years of experience in various cloud technologies within a
large-scale organization
Personal Attributes: Self-starter, Collaborative, Curious, Strong work
ethic, highly motivated, Team oriented
Experience designing and building complex data pipelines in an agile
environment
Expertise on data analysis and wrangling using sql, python, databricks
Experience with modern cloud development and design concepts; software
development lifecycle; multi-developer code versioning and conflict resolution;
planning, design, and problem resolution enterprise data applications /
solutions