Adf Python Scala Spark Databricks

Databricks Snowflake Apache Spark Kafka Aws Glue

Ci/cd Gitlab Python Data Engineering Kafka

Sql Hadoop Apache Spark Docker Kubernetes

ETL C++ Azure ADF API

Sql Aws Azure Gcp Snowflake

Sql Etl Tools Aws Azure Gcp

Python PySpark Scala Java Spark

Python Py Spark Snowflake Databricks DBs / FlatFiles / Kafka + SQL

Spark Kafka AWS SQL Databricks / AWS

PostgreSQL MySQL DB2 AWS Google Cloud

Python Spark snowflake Airflow DBT

java spark snowflake Drools and Kafka

Python AWS SQL Snowflake Kafka

A/B Test Design ChatGPT Complex SQL Queries ETL pipeline llm prompt engineering