Senior Big Data Engineer

Job Description:

Essential Functions:

• 25% Perform technical detail design, coding, testing of applications.
• Serves as subject matter expert for both customer and internal discussions related to maintaining and enhancing existing software systems.
• Develop and/or analyze interface design documentation.
• Comply with hardware and software systems standards and procedures. Deliver large systems for tens of thousands of users.
• Comply with code quality, migration and dev/ops standards and policies
• 25% Performs software analysis, including requirements and uses case development and design. Implements and documents source code to design specifications.
• Performs software testing including developing and running automated unit tests, drafting, and executing structured automated test cases.
• Compile, assess, and report data results from software testing and analysis.
• 25% Develops software solutions for enterprise environments and other technologies.
• Analyzes and implements functional and non-functional (e.g. performance, availability) requirements and designs, implements, and tests software.
• Performs operations & maintenance (O&M) of existing systems.
• Identifies areas for improvement and streamlining. Demonstrated experience with front-end and back-end programing and integration frameworks and tools.
• Assist in the estimation of development of application features
• 25% Provides direct technical support for high level, high visibility and critical trouble calls for supported applications.
• Works with cross functional teams to develop highly reliable software that runs at scale.
• Provides recommendations to infuse new technology. Extend open-source libraries and systems as necessary to meet the needs of the team.
• Play a crucial role in product scoping and roadmap / architecture discussions. Continually evaluate emerging technologies to identify opportunities, trends, and best practices.
• Mentoring of junior software engineers.

Required Skills:

• This position requires a BA/BS in Computer Science, Information Systems, Information Technology or related field with 7+ years of prior experience in software development, Data Engineering and Business Intelligence OR equivalent experience.
• Following are the some of the key skills that candidates must have.
• 7+ years of strong programming background with Java/Python/Scala.
• At least 3+ years of experience working on Data Integration projects using Hadoop MapReduce, Sqoop, Oozie , Hive, Spark and other related Big Data technologies
• At least 2+ years of experience on AWS preferably leveraging services such as Lambda, S3, Redshift, Glue services.
• Some working experience building Kafka based data ingestion/retrieval programs.
• Experience tuning Hadoop/Spark/hive parameters for optimal performance.
• Strong SQL query writing and data analysis skills.
• Good shell scripting experience.
• Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components.

Skills Nice to Have:

• Healthcare experience.
• Cloudera Developer certification