Role Overview
As a Sr. Data Engineer, you will build and optimize data pipelines that support retail media campaigns and customer journey analytics. You'll work closely with architects, analysts, and media partners to deliver scalable, privacy-compliant data solutions.
Key Responsibilities
• Build and maintain data pipelines using GCP (BigQuery, Dataflow, Composer)
• Develop Python scripts for data transformation and ingestion
• Support real-time data streaming and campaign analytics
• Collaborate with users to deliver clean, validated datasets
• Integrate with clean room environments and ensure privacy compliance
• Build data models (e.g., slowly changing dimensions) for campaign and customer journey analytics
• Lead design and POC of migration planning from GCP to Databricks – Connecting to Databricks for ML Use cases (Hosted in GCP)
• Enable real-time data ingestion and streaming (Kafka or similar)
Required Skills
• 8–10 years in data engineering
• Proficient in Python, SQL, and GCP tools (BigQuery, Dataflow, Composer)
• Experience with clean rooms (Google, Databricks)
• Familiarity with Kafka or similar streaming tools
• Strong understanding of retail media and campaign KPIs
• Expertise in ETL tools like Informatica or Talend
• API Integrations experience e.g. Facebook/Meta or similar engineering experience
• Bonus: Experience with Databricks and, Data/ ML pipelines
Any Graduate