Technical Big data Lead

Job Title: Technical Lead

Location: Maryland Heights, MO

Role Type: Contract

Contract Length: 36 Months

About the Role:

We are seeking a highly skilled and experienced Technical Lead to join our team as the Manager for Projects. The ideal candidate will have a strong background in Apache Spark, SQL Scripting, Apache Hadoop, Big Data Validation, Hive, and Unix Commands. This role involves leading technical projects, ensuring high-quality deliverables, and driving innovation within the team.

Key Responsibilities:

Lead and mentor a team of developers and data engineers. Provide technical guidance and expertise in Apache Spark, SQL Scripting, Apache Hadoop, Hive, and Unix Commands. Foster a collaborative and innovative team environment.
Plan, execute, and deliver technical projects on time and within budget. Define project scope, goals, and deliverables in collaboration with stakeholders. Develop detailed project plans to monitor and track progress.
Design and implement big data solutions using Apache Spark, Hadoop, Hive, and related technologies. Ensure data quality and integrity through robust validation processes. Optimize and tune big data workflows for performance and scalability.
Write complex SQL scripts to extract, transform, and load data. Analyse large datasets to derive actionable insights. Develop and maintain data pipelines and ETL processes.
Utilize Unix commands for system administration and automation tasks. Develop shell scripts to streamline data processing and management tasks.
Stay current with emerging technologies and industry trends. Drive continuous improvement initiatives to enhance project delivery and team productivity. Encourage a culture of innovation within the team.
Qualifications:

Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
5 to 11 years of experience in technical project management and leadership roles.
Extensive experience with Apache Spark, SQL Scripting, Apache Hadoop, Hive, and Unix Commands.
Proven track record of successfully delivering complex technical projects.
Strong problem-solving and analytical skills.
Excellent communication and interpersonal skills.
Ability to work effectively in a fast-paced and dynamic environment.