We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer (SME) to join our dynamic Payment Gateway team in Northampton,UK for a Full time Hybrid role. As an SME you will serve as a subject matter expert providing technical leadership guidance and best practices across the team.
- You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance.
- Serve as a subject matter expert in cloud data engineering providing technical guidance and mentorship to the team.
- Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR).
- Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents.
- Develop and maintain CI/CD pipelines for data engineering workflows using tools like Jenkins.
- Automate data ingestion transformation and loading processes.
- Work closely with DevOps teams and other engineering teams to ensure smooth deployment and operations of data pipelines.
- Experience working on Linux platforms and managing data on Linux servers.
Your Profile
- 7+ years of experience in data engineering with a strong focus on cloud platforms (preferably AWS).
- 3+ years of experience as a Senior Engineer or SME in a data engineering role.
- Solid experience working on Linux platforms. Experience with CI/CD pipelines and tools like .Jenkins
- Strong understanding of DevOps methodologies and principles.
- Solid understanding of data warehousing data modeling and data integration principles. Proficiency in at least one scripting/programming language (e.g. Python Scala Java). Experience with SQL and NoSQL databases.
- Familiarity with data quality and data governance best practices.
- Strong analytical and problem-solving skills.
- Excellent communication interpersonal and presentation skills.
- Desired Skills: Experience with containerization technologies (e.g. Docker Kubernetes). Experience with data streaming platforms (e.g. Kafka Kinesis).
- Experience with data visualization and business intelligence tools.
- Experience with Agile development methodologies.
- AWS Certifications (e.g. AWS Certified Data Analytics - Specialty AWS Certified Solutions Architect)