Job Description
· Design, build, and test data pipelines leveraging Azure Databricks.
· Have a deep understanding of Cloud platforms and data engineering technologies, preferably MS Azure.
· Working knowledge of Azure Databricks, Cluster Management, Apache Spark, and Python
· Strong SQL skills to perform data analysis and understanding of source data
· Highly proficient with Python and PySpark
· Familiarity with NoSQL databases and JSON formats, preferably CosmosDB
Key Technologies:
· Python
· PySpark
· SQL
· Azure Synapse Analytics Dedicated SQL Pools (SQLDW)
· Relational Databases and NoSQL Databases
· JSON
Any Graduate