Description

Detailed job description: 
• Deep understanding of Hadoop and Spark Architecture and its working principle.
• Deep understanding of Data warehousing concepts.
• Ability to design and develop optimized Data pipelines for batch and real time data processing.
• 5+ years' experience on Python or Java Hands-on experience on writing and understanding complex SQL (Hive/PySpark-data frames), optimizing joins while processing huge amounts of data.

Education

Any Graduate