APIs. Splunk and Cribl. AWS. Kinesis Spark Streaming.

Apache Spark Apache Spark Streaming Datasets Extract Transform

Kafka Spark Python Cassandra Scala

Java Python Docker Kubernetes Pub/Sub

C# / .NET Logic App Kafka MQ Azure Event Hub

Java Python GCP Pub/Sub Kafka

Hdfs Hive Apache Spark Linux Git