Description

We are seeking a skilled and experienced Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our Databricks platform. As a technical team member, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.

Key Responsibilities:
Ability to analyze data and support data preparation
Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.
Ability to build data pipelines for different ingestion patterns.
Apply data modeling concepts to pipelines.
Implement basic data validation checks in pipelines.
Automate execution and deployment of pipelines.
Collaborate with Data Platform Architects and Data Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.
Support data preparation, exploration, and visualization to facilitate data-driven decision-making.
Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.
Document current and future state data flows

Qualifications:
Bachelor’s degree in Computer Science, a technical field, or a related business discipline. Equivalent experience, certifications, or training will be considered.
5+ years of experience in designing and delivering secure cloud solutions.
2+ years of experience with Databricks
2+ years of experience with AWS (preferred)
Experience with Agile methodology
Strong problem-solving, analytical, and communication skills

Education

Bachelor's degree