Sr. Spark Developer

Responsibilities

• Responsible for Information Management in areas of Enterprise Architecture Planning, Data Governance, Master Data Management, and Data Warehousing.
• Responsible for the design, development and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or mathematics.
• IT Developers are responsible for development, program, coding of Information Technology solutions.
• Manage tasks independently and take ownership of responsibilities.
• Ensure process compliance and manage expectations of the leadership.
• Actively participate in brainstorming session and provide solid inputs to the team and ensure best practices are followed within the team.

Required Skills

• Should have skills in write code for moderately complex system designs. Write programs that span platforms. Code and/or create Application Programming Interfaces (APIs).
• Proficiency using versioning tools.
• Thorough knowledge of Information Technology fields and computer systems.
• Ability to learn from mistakes and apply constructive feedback to improve performance.
• In-depth understanding of the systems development life cycle.
• Proficiency using standard desktop applications such as MS Suite and flowcharting tools such as Visio.
• Proficiency using debugging tools.

Required Experience

• 3 years of development experience with Python Spark Java.
• 3 years of Hadoop experience Horton Works preferred.
• Experience in writing complex ETL for batch and real time data processing. Spark Streaming, Scala, Hadoop, HIVE, HDFS.
• Experience and understanding with unit testing, release procedures, coding design and documentation protocol as well as change management procedures.
• Experience operating and leading in a matrix organization with a global footprint.
• Experience with presenting complex topics to senior stakeholders and incorporating feedback to drive the overall program in the direction set by a senior steering group.
• Experience in building UI/dashboards a plus.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.