Description

Project Description:
In this project the Data Engineering team is supporting the enterprise analytical data environment called UDH. UDH is a complex data environment built on AWS services technologies.
Responsibilities:
Support large scale data pipelines in a distributed and scalable environment
Enable and optimize production AWS environment for data infrastructure and frameworks
Partner with development teams and other department leaders/stakeholders to provide cutting edge technical solutions that enable business capabilities
Participate and lead in design and development of innovative batch and streaming data applications using AWS technologies
Provide the team technical direction and approach to be undertaken and guide them in resolution of queries/issues
Mandatory Skills Description:
-Bachelor's degree or 4 years of relevant work experience
-8+ years in IT or Software Engineering
-Experience with the following:
Big Data Technologies
AWS Services (Airflow, Glue, Lambda, others; hands-on AWS Technology leader)
Spark and PySpark
Thorough in one or more programming languages
Linux
SQL
Python
Bash scripting
-Thorough troubleshooter
-People person and ability to conclude an undertaking
-Able to solve problems under pressure and in constrained scenarios,
-Leadership experience

Education

Bachelor's degree in Computer Science