Senior Data Engineer

Job Description

Organization Objective/Purpose:

• This position in the Engineering team under the Digital Experience organization. We drive the first mile of the customer experience through personalization of offers and content. We are currently on the lookout for a smart, highly driven engineer.
• You will be part of a team that is focused on building & managing solutions, pipelines using marketing technology stacks. You will also be expected to Identify and implement improvements including for optimizing data delivery and automate processes/pipelines.
• The incumbent is also expected to partner with various stakeholders, bring scientific rigor to design and develop high quality solutions.
• Candidate must have excellent verbal and written communication skills and be comfortable working in an entrepreneurial, ‘startup’ environment within a larger company.

Brief Description of Role:

• Experience with both structured and unstructured data
• Experience working on AdTech or MarTech technologies.
• Experience in relational and non-relational databases and SQL (NoSQL is a plus).
• Understanding of Data Modeling, Data Catalog concepts and tools
• Ability to deal with data imperfections such as missing values, outliers, inconsistent formatting, etc.
• Collaborate with other members of the team to ensure high quality deliverables
• Learning and implementing the latest design patterns in data engineering

Qualifications

Data Management:

• Experience with both structured and unstructured data
• Experience building Data and CI/CD pipelines
• Experience working on AdTech or MarTech technologies is added advantage
• Experience in relational and non-relational databases and SQL (NoSQL is a plus).
• Hands on experience building ETL workflows/pipelines on large volumes of data
• Good understanding of Data Modeling, Data Warehouse, Data Catalog concepts and tools
• Able to identify, join, explore, and examine data from multiple disparate sources and formats 
• Ability to reduce large quantities of unstructured or formless data and get it into a form in which it can be analyzed 
• Ability to deal with data imperfections such as missing values, outliers, inconsistent formatting, etc.

Development:

• Ability to write code in programming languages such as Python and shell script on Linux
• Familiarity with development methodology such as Agile/Scrum
• Love to learn new technologies, keep abreast of the latest technologies within the cloud architecture, and drive your organization to adapt to emerging best practices
• Good knowledge of working in UNIX/LINUX systems

Qualifications:

• Bachelor’s degree in computer science with 5+ years of similar experience
• Tech Stack: Python, SQL, Scripting language (preferably JavaScript)
• Experience or knowledge on Adobe Experience Platform (RT-CDP/AEP)
• Experience working in Cloud Platforms (GCP or AWS)
• Familiarity with automated unit/integration test frameworks
• Good written and spoken communication skills, team player.
• Strong analytic thought process and ability to interpret findings 

In addition, the candidate should have strong business acumen, and interpersonal and communication skills, yet also be able to work independently. He/she should be able to communicate findings and the way techniques work in a manner that all stakeholders, both technical and non-technical, will understand.