Data Engineer

A Data engineer is an IT professional responsible for any technological duties associated with cloud computing, including design, planning, management, maintenance and support.

• Experience working with large scale data sets
• Experience working with agile methodologies and cross-functional teams (Product Owners, Scrum Masters, Developers, Test Engineers)
• Python for scripting and automation.
• Expert at building performant data pipelines and optimizing existing workflows for new features
• Understand the Data Lifecycle and concepts such as lineage, governance, privacy, retention, anonymity, etc.
• Excellent communication, organizational, and analytical skills.
• Implement, maintain and operate data pipelines using Apache Spark/Scala, and cloud data infrastructure