Detailed job description:
• Deep understanding of Hadoop and Spark Architecture and its working principle.
• Deep understanding of Data warehousing concepts.
• Ability to design and develop optimized Data pipelines for batch and real time data processing.
• 5+ years' experience on Python or Java Hands-on experience on writing and understanding complex SQL (Hive/PySpark-data frames), optimizing joins while processing huge amounts of data.
Any Graduate