Kafka Hadoop Hive Python Ci/cd Pipeline

Python Java Scala Perl Shell

Java AWS GCP Kinesis Spark

Python Power Bi Informatica Pentaho Apache Airflow

Python Go Java Spark Hadoop

Java Hive HDFS Spark Git

Python HADOOP Hive PySpark Oozie

(MySQL PostgreSQL SqlServer Oracle (MapReduce

Hadoop Hdfs Pig Hive Zookeeper

HADOOP HIVE PYSPARK

Scala HDFS Hive Spark Streaming

Core Java spring boot Oracle microservices Kafka

data warehouse Cloudera Hadoop SCALA big data data lake

Shell Script Python Mapreduce Spark. Hive Hbase

AWS S3 Glue ETL Glue Catalog Athena PySpark