Software Engineer

Responsibilities:

• Partner with Program, Data Science and Engineering -teams to understand Client Maps analytics data needs
• Design and build data processing pipelines in a hybrid cloud environment
• Design data models for optimal storage and retrieval
• Design and develop new data processing systems to enable quick and easy consumption and augmentation of data
• Design and develop CI/CD for Analytics Platform needs
• Build data expertise and develop methods to monitor data quality

Requirements:

• 4+ years of experience in data processing platform development
• 4+ Experience with Java or Scala
• Experience with data processing using Spark, Hadoop, MapReduce and SparkSQL
• Experience with SQL or other declarative data extraction languages
• Experience with Amazon Web Services
• Experience with Gradle or similar build automation system
• B.S or advanced degree in Computer Science or related field
• Experience in big data processing platform and framework development
• Experience with Amazon Web Services, GCP or Azure
• Experience with real time data processing using Kafka and Storm or Spark Streaming