Will act as a lead to 2 people on the team by reviewing their code
Manage CI/CD
Speak to customers and upstream people
Build/maintain data pipelines
Will specialize in testing, validating, and deploying data systems ensure that big data solutions are robust, reliable, and ready for production
Proof of concept - demonstrate the feasibility and functionality of a proposed solution (validate key aspects of architecture, technology, or workflows)
Requirements:
5+ years of experience as a senior Data engineer. Lead experience would be a plus
Experience with Big Data Ecosystem (Spark and Scala)
Apache Hive experience because they use it for their Data warehouse