Azure Data Engineer

Title: Azure Data Engineer

Location: Montvale, NJ/Onsite

Duties:

• Proven experience as a Data Engineer, with a strong focus on Azure Synapse Analytics.
• Proficiency in Python for data manipulation, scripting, and automation.
• Expertise in Azure services, including Azure Data Factory, Azure SQL Database, and Azure Storage.
• Hands-on experience with Azure AI Document Intelligence for document processing and data extraction.
• Create, manage, and optimize ETL processes to ensure efficient data flow and high data quality.
• Strong understanding of data warehousing concepts, ETL processes, and data modeling techniques.
• Monitor and troubleshoot data systems, ensuring optimal performance and reliability.
• Implement best practices for data security, metadata management, and compliance with organizational policies.
• Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
• Effective communication and interpersonal skills.
• Act with integrity, professionalism, and personal responsibility to uphold the firm’s respectful and courteous work environment.

Skills:   

• Python (more than 3 years’ experience with libraries to extract data from PDF, MS office files).
• Azure Synapse to create data Python pipeline jobs and clusters (REQUIRED)
• Good knowledge of API integration
• Expertise in Azure services, including Azure Data Factory, Azure SQL Database, and Azure Storage
• Proven experience as a Data Engineer, with a strong focus on Azure Synapse Analytics.
• Proficiency in Python for data manipulation, scripting, and automation.
• Hands-on experience with Azure AI Document Intelligence for document processing and data extraction.
• Create, manage, and optimize ETL processes to ensure efficient data flow and high data quality.
• Strong understanding of data warehousing concepts, ETL processes, and data modeling techniques.
• Monitor and troubleshoot data systems, ensuring optimal performance and reliability.
• Implement best practices for data security, metadata management, and compliance with organizational policies.
• Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
• Effective communication and interpersonal skills.
• For emerging skill sets, years of experience may matter less than depth of knowledge & expertise but traditionally may have 5-10 years of experience