Python PySpark T-SQL / SQL Apache Spark Apache Airflow

Scala Spark Hadoop Kafka Postgres SQL

Bioinformatics Python Perl Apache Airflow Sql Scripts

Snowflake Python Apache Airflow AWS Teradata

Kubeflow TensorFlow PyTorch Airflow Databricks

AWS Spark Python Hive Airflow

ApacheBeam SpringBoot Dataflow Airflow BigQuery

Hadoop Spark Cloud Scala Sql

ETL framework (eg. Airflow Oozie Jenkins Python or PySpark Unix scripting.

SQL Python Apache Airflow PubSub Kafka

Aws Snowflake Dbt Airflow

Python Apache Nifi Apache Airflow AWS Glue Azure Data Factory

T-SQL / SQL Python Apache Spark Apache Airflow Microsoft SQL Server

Big Query Data Proc Airflow Cloud Composer Gcp Hydra Services

Python R Hadoop Spark AWS