Azure Data Engineer

Required Skills: Azure Event Hub, PySpark, Azure Key Vault, Databricks Workflows, Databricks CLI, Databricks SQL, Databricks Workspace Admin

Responsibilities:

• Lead the development and implementation of geospatial data solutions using PySpark and Databricks technologies.
• Oversee the integration of data from various sources into Azure Event Hub for real-time processing.
• Provide expertise in managing and securing data using Azure Key Vault.
• Develop and maintain Databricks Workflows to automate data processing tasks.
• Administer Databricks Workspace to ensure optimal performance and security.
• Utilize Databricks SQL to perform complex queries and generate insights from geospatial data.
• Implement and manage Databricks CLI for efficient data operations and management.

Qualifications:

• Possess strong expertise in PySpark for data processing and analysis.
• Have extensive experience with Azure Event Hub for real-time data integration.
• Demonstrate proficiency in managing data security with Azure Key Vault.
• Show advanced knowledge of Databricks Workflows for automation.
• Have experience in Databricks Workspace administration.
• Be skilled in Databricks SQL for querying and data analysis.
• Be proficient in using Databricks CLI for data operations.