AWS Spark Python Hive Airflow

java Scala Spring Boot Spring Batch Apache Spark

Cloudera HDFS HIVE Cassandra/ MongoDB R

Cloudera Hadoop data lake kafka sql spark

ETL framework (eg. Airflow Oozie Jenkins Python or PySpark Unix scripting.

Mapreduce Hbase Eclipse Xml Json

PySpark Write SQL Queries DevOps AWS S3 HIVE

SQL/NoSQL databases Oracle Hive Netezza XML

Cloudera Hadoop Spark Hive Impala

Hive Hbase Spark Hue Prometheus

Scala Spark Python Big Data Kafka Aws

S3 Lambda Redshift Glue Rds

PostgreSQL MySQL Spark PySpark Hive

EC2 EMR S3 Glue Redshift

Java Spring Boot Rest Maven Jenkins