Seeking a Senior Data Engineer to design and optimize scalable data pipeline architectures and support analytics needs across cross-functional teams.
Key Responsibilities:
- Design, build, and maintain data pipelines (ETL/ELT) using BigQuery, Python, and SQL
- Optimize data flow, automate processes, and scale infrastructure
- Develop and manage workflows in Airflow/Cloud Composer and Ascend (or similar ETL tools)
- Implement data quality checks and testing strategies
- Support CI/CD (DevSecOps) processes, conduct code reviews, and mentor junior engineers
- Collaborate with QA/business teams and troubleshoot issues across environments
Core Skills:
- BigQuery, Python, SQL, Airflow/Cloud Composer, Ascend or similar ETL tools
- Data integration, warehousing, and pipeline orchestration
- Data quality frameworks and incremental load strategies
- Strong experience with GCP or AWS serverless data warehouse environments
Preferred Skills:
- DBT for transformation
- Collibra for data governance
- Working with unstructured datasets
Qualifications:
- 5+ years in data engineering
- Graduate degree in CS, Statistics, or related field
- Strong analytical and SQL expertise