Scala HDFS Hive Spark Streaming

Hadoop Hive IBM DB2 SQL Server Oracle

Spark Oozie HDFS Yarn Hive

Hadoop HBase Hive Pig MapReduce

Big Data/Hadoop Cloudera Hortonworks HDFS MR2

HDFS YARN YARN Queue Manager Ranger Atlas

Spark Scala Java J2EE Python

Cloudera HDFS HIVE Cassandra/ MongoDB R

Cloudera Hadoop data lake kafka sql spark

ETL framework (eg. Airflow Oozie Jenkins Python or PySpark Unix scripting.

Python HADOOP Hive PySpark Oozie

SQL PL/SQL Hadoop Flume Solr

Apache Impala Apache Kafka PySpark Sqoop Apache Oozie

BDM Power Exchange Power Center Hadoop Hive

Python Sql Shell Scripting Aws Snowflake