- Act as the lead engineer for each domain
- Collaborate with Solution Architects to ensure understanding needed for engineering level guidance to nearshore teams
- Translate architecture design to engineering level guidance
- Own specifying architectural designs into sprint-ready engineering tasks for assigned domain
- Ensure delivery to the solution architecture within domain
- Answer design questions for sprint teams
- Participate in backlog refinement sessions to align team with the architecture
- Act as the internal technical expert supporting Product design and Engineering teams on demonstrations and technical discussions.
- Create/Update documentation such as solution design patterns and engineering standards.
- Lead technical discussions around APIs, integrations, data flow, compliance and security.
- Serve as a trusted advisor on best practices, technical implementation, and scalability.
Skills and Experience Required:
Required:
- Experience with Python, Spark, Databricks, Azure Event Hub, ADF, Delta Lake Tables
- Able to write optimized ETL pipelines, manage distributed compute jobs, and handle large-scale data transformations.
- Experience with Azure Data Factory (orchestration) and Azure Event Hub (ingestion/event streaming)
- Should know how to manage data movement, ingestion triggers, and pipeline tuning in a production Azure environment.
- Able to code in Spark, and understand execution models, partitioning strategies, caching, broadcast joins, and how these affect performance in Azure's ecosystem.
- Able to collaborate with Solution Architects and lead technical discussions
- Lead developer experience working with a team of at least 12