Databricks Engineer

Must Haves:

• #1 Must understand how to be an Engineer
• #2 Must understand cloud Data Bricks

Day to day:

• The Data Engineer will work on analytics for claims, P&L, Commercial, and Excell Surplus
• Advanced Data Bricks is the focus
• Ask right questions and ask the follow up questions
• Working on Data products
• Understanding of Analytics – Power BI and Platform & Data visualization
• Work closely with Data Scientists on data visualization projects.
• Communication skills need to be strong – this has been a challenge – need to work with business stakeholders – be in front insurance teams
• Big plus if understand insurance business
• Overall 10% in interaction with business stakeholders and 90% is engineering

Responsibilities

• Hands on development and support of new or existing data applications.
• Work closely with business and analysts to understand data and business process and make recommendations to clients as requested on best practices or long-term solutions to resolve current issues and also for future system design
• Works closely with Application and Enterprise Architects to create/review low level implementation designs, understand high level data flow designs developed by data architects.
• Provide technical guidance to the team for implementing complex data solutions.
• Provide support in the design, development, code reviews, test deploy and documentation of data engineering and data integration Applications.
• Maintain detailed documentation to support downstream integrations
• Provide support for production issues
• Performs activities of a scrum master
• Identify technology trends and explore opportunities for use within the organization

Qualifications

• Five to ten years of experience in Data Warehousing, Data integration or Data Engineering projects
• Experience in Azure Databricks
• Practical experience of data modeling and impact of models on KPIs
• Need someone who thinks outside the box and make recommendations vs just take orders
• Experience with interacting with other On Prem ERP/ ETL systems e.g. Informatica Powercenter, IICS, Cognos, Netezza Performance servers (these are the ones client uses so it's not mandatory to have experience with these systems but the candidate should have similar exposure)
• Experience working within Azure ecosystem
• Some experience in any of these analytical platforms - PowerBI, AzureML, Databricks or Synapse
• Proficient in SQL
• Experience using Python or Scala.
• Experience in Azure DevOps and Github is preferred
• Ability to effectively work well with people in other departments and/or outside of the enterprise.
• P&C Insurance experience is preferred
• Possesses excellent communication skills.
• Bachelor's degree in computer science or related engineering field preferred.