Java spark flink SNS SQS

HDFS Hive Spark Scala Sqoop

Python PySpark PyTorch Tensorflow Keras

core Java Scala Spark Python HDFS

Apache Beam Apache Spark Kafka Apache Flink and Apache Pinot

Aws Cloud Services Sql Python Pyspark Flink

Kubernetes Docker Nosql Kafka Spark

Java JVM Python/JavaScript C Linux

PySpark Scala Spark AWS cloud AWS DocuDB

SPARK STORM Hive Kafka HDFS

Hadoop Spark Kafka EMR redshift

Python SQL AWS Azure deep learning frameworks

Python ETL PostgreSQL MS SQL Spark

Java NoSQL Kafka Spark HDFS

Hadoop Spark Kafka MongoDB Databricks