Lead Data Engineer

Job Description

• 10-12 years of industry experience
• Accountable for the successful implementation and robust design of data pipelines and processes
• Including the close review of a data engineer working under him
• This is within Fintech backend and integrations with an external vendor
• Key team member who understands ongoing data development at a deep level – defines macro sprint objectives for backend data team
• Solutioning: Responsible for all data architecture design, including ETL definition, IaC, and data model definition.
• Works with backend lead
• Implementing: Portion of time is spent on hands-on keyboard development on key data initiatives such as: ETL setup for ingestion of both batch and stream data internally/externally
• Operational DB setup, role provisioning as needed for incremental data resources (S3 bucket, tables, etc.)
• Terraform and Infrastructure as Code (IaC) for deploying to multiple environments
• Analytics setup, primarily in setting up and sending data via Snowflake pipeline for TMO to do broader analytics and enable KPIs
• “Voice of Fintech data”: Works closely with internal lead architects + backend leads as well as mid-senior technical clients to help drive understanding of Fintech data, shape client perspectives on feasibility (scope of analytics).