AWS Data Engineer

Role Summary:

The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the datastructure required for robust analytics.

Key Responsibilities:

• Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
• Collaborate with the Data Architect to implement data models and ensure data integrity.
• Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
• Monitor and optimize data processing workflows, ensuring efficient resource usage.

Skills and Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
• Strong skills in SQL and data pipeline development.
• Experience leading data engineering teams and optimizing ETL workflows