Sr. Hadoop

We are seeking a highly skilled and experienced Sr. Hadoop, Hive, Spark, Java, Python, and SQL Developer with 12+ years of overall IT experience, including 6-8 years specifically in the required skills, to join our team supporting a major client in the Investment Banking industry. This role will be instrumental in designing, developing, and maintaining robust and scalable data solutions within a complex financial environment. The ideal candidate will possess a strong background in big data technologies, programming, and a proven track record of delivering high-quality software solutions.

Responsibilities:

• Design, develop, and implement efficient and scalable big data solutions using Hadoop, Spark (including HDFS, MapReduce, Hive, and Spark), Java, Python, and SQL.
• Develop and maintain data pipelines for ingestion, processing, and analysis of large datasets.
• Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL) processes.
• Utilize Java and Python for scripting, data processing, and application development within the Hadoop/Spark ecosystem.
• Collaborate with business analysts and stakeholders to understand requirements and translate them into technical solutions.
• Participate in code reviews and ensure adherence to coding best practices and standards.
• Troubleshoot and resolve performance bottlenecks and other technical issues.
• Contribute to the continuous improvement of our data platform and development processes.
• Work in an Agile environment and participate in sprint planning, daily stand-ups, and retrospectives.
• Maintain up-to-date knowledge of industry trends and emerging technologies in the big data space.
• Demonstrate strong communication skills to effectively collaborate with team members and stakeholders.

Required Skills:

• Overall IT Experience: 12+ years of experience in Information Technology.
• Big Data Technologies: 6-8 years of extensive experience with Hadoop ecosystem components, including HDFS, MapReduce, Hive, and Spark.
• Programming Languages: 6-8 years of proficiency in Java and Python, with a strong understanding of object-oriented programming principles.
• SQL: 6-8 years of strong SQL skills for data manipulation, querying, and analysis.
• Financial Industry Experience: Prior experience working in the financial services or investment banking domain is essential.
• Communication Skills: Excellent written and verbal communication skills in English.

Certifications:
Relevant certifications in Hadoop, Spark, Java, or other related technologies are a plus