Senior AI Data Engineer

What You'll Do:

Enable the organization to effectively leverage its data assets for decision-making, innovation and strategic growth. Use engineering skills to optimize data processing and storage systems for performance, scalability, and cost-effectiveness. Roles in this family involve a combination of software engineering, database management and the analysis of data.

Apply the knowledge of data characteristics and data supply pattern, develop rules, and tracking process to support data quality model.

Prepare data for analytical use by building data pipelines to gather data from multiple sources and systems.

Integrate, consolidate, cleanse and structure data for use by our clients in our solutions.

Perform design, creation, and interpretation of large and highly complex datasets.

Stay up-to-date with the latest trends and advancements in GCP and related technologies,

Actively proposing and evaluating new solutions.

Understand best practices for data management, maintenance, reporting and security and

Use that knowledge to implement improvements in our solutions.

Implement security best practices in pipelines and infrastructure.

Develop and implement data quality checks and troubleshoot data anomalies.

Provide guidance and mentorship to junior data engineers.

Review dataset implementations performed by junior data engineers.

What Experience You Need:

BS degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred

5+ years of experience as a data engineer or related role

Cloud certification strongly preferred

Advanced skills using programming languages such as Python or SQL and intermediate level experience with scripting languages

Intermediate level understanding and experience with Google Cloud Platforms and overall cloud computing concepts, as well as basic knowledge of other cloud environments

Experience building and maintaining moderately-complex data pipelines, troubleshooting issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects

Experience designing and implementing moderately and more complex data models and experience enabling optimization to improve performance

Demonstrates advanced Git usage and CI/CD integration skills

Requires in-depth knowledge and experience needed to operate independently with limited guidance and oversight

Applies a new perspective on existing solutions to solve complex problems

Makes decisions within guidelines and policies that impact a range of customer, operational, process, or project activities

Develops work plans for short-term assignments of moderate or high complexity

Solid experience in data analysis, machine learning, and AI development

Hands-on experience with cloud-based AI platforms and tools

Strong analytical and problem-solving skills

Ability to work independently and as part of a team

Good communication and presentation and visualisation skills

What Could Set You Apart:

Experience with specific AI techniques, such as neural networks or natural language processing

Knowledge of the financial services industry

Contributions to open-source AI projects

Experience with data visualization tools