Senior Data Engineer with Python, PySpark

Skills Needed:

• Mandatory: Python with Object oriented concepts, PySpark, Problem Solving ability, Effective communication
• Good to Have: AWS

 
Detailed Job Description:

• Customer is currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming.
• The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python.
• This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.
   

Responsibilities:

• Design, develop and implement new features to our existing framework using PySpark and Python.
• Write efficient and effective standalone scripts in PySpark with transformations as per the defined business logic.
• Use your expertise in Python and Object-oriented concepts to solve complex problems and implement robust solutions.
• Work closely with the team to understand the requirements and develop solutions that align with the company's objectives.
• Test and debug code to ensure it produces the desired results.
• Document all programming tasks and procedures for future reference and troubleshooting.
   

Qualifications:

• Proficient in Python, PySpark, and Object-oriented programming concepts.
• Proven experience as a Senior Data Engineer or similar role.
• Strong problem-solving techniques with an ability to troubleshoot complex software issues.
• Experience with AWS is preferred, but not mandatory.
• Excellent communication skills, both written and verbal.
• Self-motivated and able to work independently with minimal supervision