Hands on experience as an Azure data engineer which includes.
Design and implement highly available and scalable Azure cloud data solutions that meet business requirements.
Developing and maintaining data lake and data warehouse schematics, layouts, architectures and relational/non-relational databases for data access and Advanced Analytics.
Strong experience with Azure cloud technologies, including Azure Data Factory, Azure Data Bricks, Cosmos DB.
Experience with data transformation and manipulation using Azure Databricks.
In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.
Working knowledge of Azure DevOps -CI/CD tools and concepts - Azure Pipelines, GitHub Workflow,
Architect data ingestion solutions such as ETL, ELT on a wide set of data storage solutions.
Scripting experience with Python and Rest API Experience with Python Fast API.
Troubleshooting skills to drive to root cause.
Experience working in an Agile development environment.
Demonstrates strong written and oral communications skills. Ability, desire, and focus to meet deadlines.
Skills Required:
1) Python
2) Spark -PySpark
3) ADF (Azure Data Factory)
4) ADB (Azure Data Bricks)
5) SQL
6) Azure Cloud Infrastructure.
Nice to Have:
Experience in data integration with API's.
Exposure to Azure Functions.
Working knowledge with Azure Infrastructure, security, token management.
Working knowledge with: Azure DevOps /CICD,
Python Fast API Knowledge
Working Knowledge on Rest APIs.
Working knowledge on using Postman for Rest APIs.
Working Knowledge on Cosmos DB.
Any Graduate