Hadoop stack HDFS MapReduce Yarn HIVE

Erwin SQL Confluence SharePoint Collibra

Big Data/Hadoop Cloudera Hortonworks HDFS MR2

HDFS YARN YARN Queue Manager Ranger Atlas

Scala Spark Hadoop Kafka Postgres SQL

ETL Designs SQL Server Teradata scanners Hive Oracle

Hive PySpark Big Data Spark SQL

AWS Spark Python Hive Airflow

java Scala Spring Boot Spring Batch Apache Spark

HiveQL BigQuery data analysis Scala Python

Big Data Pig Hive Mahout SparkML

C Programming Language Shell Scripting Git Vertica Linux

Cloudera Hadoop data lake kafka sql spark

ETL framework (eg. Airflow Oozie Jenkins Python or PySpark Unix scripting.

Mapreduce Hbase Eclipse Xml Json