Key Skills: GCP, Data Engineer, BigQuery, ETL, Cloud SQL, Kubernetes Engine.
Roles & Responsibilities:
- Architect and design scalable, secure, and cost-efficient platforms on GCP leveraging services like BigQuery, Dataflow, Cloud SQL, Anthos, Cloud Spanner, Dataflow, Pub/Sub, and Kubernetes Engine (GKE).
- Incorporate data virtualization tools (e.g., Starburst, Denodo, or similar) into platform design to enable unified access to diverse data sources.
- Develop architectural blueprints and frameworks for cloud-native, hybrid, and on-premises integrations.
- Strong understanding of data architecture, ETL/ELT processes, and data governance.
- Strong understanding of SQL, distributed query optimization, and virtualized data layer design.
- Proficiency with infrastructure-as-code tools like Terraform and deployment pipelines (CI/CD).
- Partner with product managers, architects, and business stakeholders to understand requirements and translate them into technical solution.
- Expertise in designing cloud-native and hybrid architectures with micro services and server less technologies.
- Advocate for cloud-native approaches and server less technologies where appropriate.
- Evaluate and recommend tools and frameworks to enhance development efficiency and performance.
- Evaluate and implement strategies for improving data query performance in virtualized environments.
- Proactively identify and resolve system bottlenecks and technical issues.
- Knowledge of machine learning workflows and AI/ML platforms is a plus.
Skills Required:
- 10+ years of experience in software engineering, with at least 3 years' experience with GCP services.
- Familiarity with distributed systems, data pipelines, and AI/ML platforms on GCP.
- Knowledge of Python, Java, or Go for scripting and application development on GCP.
- Familiarity with multi-cloud architectures and hybrid cloud solutions.
- Banking experience is must (prior experience with HSBC Preferred).
- Preferred Cloud certifications (e.g., AWS Solutions Architect, GCP Cloud Architect, GCP Professional Data Engineer, Azure Developer Associate).
Educations: Bachelor's degree in computer science, Information Technology, or a related field