Data Engineer

Responsibilities

• Leverage enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses.
• Guide high level data architecture design (functional, non-functional) and ensures teams adhere to data architecture standards.
• Develop information processes for data acquisition, data transformation, data migration, data verification, data modeling, and data mining.
• Accountable for cost viability and technical estimation of data platform usage.
• Design data solutions for data distributions and partitions, scalability, disaster recovery and high availability.
• Design security for data policies and standards.
• Monitor and optimize data solutions.
• Actively governs and automates standard data architecture patterns and blueprints.
• Partner with architecture, security, infrastructure, and application teams to design and implement the automation of data, data platforms, and tools.
• Create and update automation to eliminate routine management processes.
• Articulate the need for scalability and understand the importance of improving quality through testin.

Required Skills

• In depth understanding and proficiency in automation of cloud platforms and data platforms.
• Expertise in on-prem and cloud database automation and platform automation with Azure.
• Proficiency with cloud automation tooling such as Ansible and Terraform.
• Proficiency with DevOps and CI/CD methodologies and tools for automated infrastructure code test, integration, deployment, and assurance.
• Proficiency with Languages such as Ruby, bash, Python or Go.
• Strong problem-solving skills.
• Strong collaboration skills and excellent verbal and written communication skills.

Required Experience

• 5+ years of hands-on experience with data platforms.
• Experience in designing data solutions in Azure including data distributions and partitions, scalability, disaster recovery and high availability.
• Experience in monitoring and optimizing data solutions in Azure including using Azure Monitor.
• Experience in implementing data solutions in Azure including Azure SQL.
• Azure Synapse, Cosmos DB, Databricks, ADLS, Blob Storage, ADF, Azure Stream Analytics.
• Experience in designing security for data policies and standards.
• Experience with Software Development and automation methodologies.
• Experience with data security best practices.

Education Requirements

• Bachelor’s Degree in Computer Science, Computer Engineering or a closely related field.