Data Engineer - AWS

Job Description

Data Engineer - AWS

Job Functions / Responsibilities  

Should able to manage applications in AWS cloud, cloud APIs to support near-real-time integrations using an AWS-based technology stack  

Should have worked on critical and small enhancement  

Should able to delegate work and take ownership   

Should able to work with product owner, other stakeholders, good in customer engagement   

Contribute to overall architecture, framework, and design patterns to store and process high data volumes  

Design and implement reporting and analytics feature in collaboration with product owners, reporting analysts / data analysts, and business partners within an Agile / Scrum methodology  

Proactively support product health by building solutions that are automated, scalable, and sustainable – be relentlessly focused on minimizing defects and technical debt  

Provide post-implementation production support for data pipelines   

Qualifications  

Bachelors' degree in Computer Science or a related field required  

5+ years of experience in a data engineering role  

2+ years of development experience with AWS and related services like EMR, ECS, EC2, S3, SNS, Lambda, IAM, Snowflake  

Good to have experience in Debezium , Kafka, SQLLITE, Apache Hudi, Hadoop, YARN, Spark, Apache Hive, Ray cluster  

Basic hands on experience in GitHub pipeline actions and deployment  

Basic proficiency in SQL, APIs, and Python  

Experience with RDBMS platforms, such as MS SQL Server, MySQL, Postgres, MongoDB  

Experience with participating in time sensitive projects in a highly collaborative, multi-disciplinary team environment  

Experience with streaming data preferred