Title: Azure Data Engineer
Location: Montvale, NJ/Onsite
Duties:
- Proven experience as a Data Engineer, with a strong focus on Azure Synapse Analytics.
- Proficiency in Python for data manipulation, scripting, and automation.
- Expertise in Azure services, including Azure Data Factory, Azure SQL Database, and Azure Storage.
- Hands-on experience with Azure AI Document Intelligence for document processing and data extraction.
- Create, manage, and optimize ETL processes to ensure efficient data flow and high data quality.
- Strong understanding of data warehousing concepts, ETL processes, and data modeling techniques.
- Monitor and troubleshoot data systems, ensuring optimal performance and reliability.
- Implement best practices for data security, metadata management, and compliance with organizational policies.
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
- Effective communication and interpersonal skills.
- Act with integrity, professionalism, and personal responsibility to uphold the firm’s respectful and courteous work environment.
Skills:
- Python (more than 3 years’ experience with libraries to extract data from PDF, MS office files).
- Azure Synapse to create data Python pipeline jobs and clusters (REQUIRED)
- Good knowledge of API integration
- Expertise in Azure services, including Azure Data Factory, Azure SQL Database, and Azure Storage
- Proven experience as a Data Engineer, with a strong focus on Azure Synapse Analytics.
- Proficiency in Python for data manipulation, scripting, and automation.
- Hands-on experience with Azure AI Document Intelligence for document processing and data extraction.
- Create, manage, and optimize ETL processes to ensure efficient data flow and high data quality.
- Strong understanding of data warehousing concepts, ETL processes, and data modeling techniques.
- Monitor and troubleshoot data systems, ensuring optimal performance and reliability.
- Implement best practices for data security, metadata management, and compliance with organizational policies.
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.
- Effective communication and interpersonal skills.
- For emerging skill sets, years of experience may matter less than depth of knowledge & expertise but traditionally may have 5-10 years of experience