Data Engineer

Key Skills: Apache Spark, SparkSQL, Python, GCP

Roles and Responsibilities:

• Full Stack Data Engineer role is expected to own and manage end to end activities within the team.
• Person would be entrusted to develop solutions/design ideas related to Data Engineering, service upkeep, developing new capabilities and identify design ideas to enable the software to meet the acceptance and success criteria.
• Work with architects/BA to build data components on the Big data environment.
• Define and contribute at a high-level to many aspects of the collaborative agile development process.

Skills Required:

Must Haves:

• Hands-on experience with Data Engineering (spark, scala, Hadoop and scheduling services like apache airflow).
• Hands-on experience or understanding on DevOps related to Jenkins CI/CD.
• Hands-on experience in building microservices (java/SpringBoot stack).
• Expertise in software development.
• Promoting development standards, code reviews, mentoring, knowledge sharing.

Good to have skills:

• Experience working with cloud applications/infrastructure.
• Python and applications/services built with python.
• Integrating with an established, complex Hadoop-based project adhering to tight deadlines.
• Working with globally dispersed and diversified teams.
• Supporting specific use-cases and onboarding new use-cases.

Education: Bachelor's Degree in related field