Python Spark developer

Responsibilities

• Create salable and high-performance API’s for data tracking/data querying.
• Work in a fast-paced, creative atmosphere to develop new ideas that adapt to evolving user needs.
• Analyze data (which attributes make the most sense, variable attribution).
• Understand how data is useful to the enterprise.
• Rapid development of prototype and proof of concepts to demonstrate how to improve developer productivity in delivering data-driven cloud applications.
• Partner closely with our data scientists to ensure the right data is made available in a timely manner to deliver compelling and insightful solutions.
• Design, build and launch shared data services to be leveraged by the internal and external partner developer community.
• Implement patterns and practices that can be replicated across the organization.

Required Skills

• Knowledge of ETL concepts and Shell – Dos, Bash scripting is good to have.
• Strong visual and verbal communication skills.
• Inquisitive, proactive and interested in learning new tools and techniques.
• Strong oral, written and interpersonal communication skills.

Required Experience

• 3 years of development experience with Python Spark Java.
• 2 years of business intelligence and reporting experience.
• 1+ years of business intelligence and reporting experience.
• Strong experience on Spark, Py-Spark, Hive and SQL is a MUST.
• SAS programming experience in model implementation reporting and complex data manipulations.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.