Python Spark Scala ADF Dataflows

Azure Data Factory/Lake Databricks python spark SQL

Cloud pub-sub Kafka Kinesis NoSQL MapReduce

REST Swagger/OpenAPI SOAP WSDL HTTP/HTTPS

Python Shell Scripting Kafka

Kafka Kubernetes MQ plants Python Ansible

SQL Python Pyspark Scripting Kafka

Glue EMR Pyspark Amazon AWS

SnowFlake Data Flow Data Composer Kafka Python

Scala Spark Python Big Data Kafka Aws

Kafka clusters. CI/CD Bash Python JMX Metrics

S3 Lambda Redshift Glue Rds

AWS GCP Kafka ostgreSQL Redis

Scala Java C++ Php Python

Python Shell Script Hadoop Perl Script Spark