Data Engineer

Responsibilities:

• Technical leadership for the expansion and optimization of data collection and data pipeline architecture

• Subject matter expert in development and integration with Web Services and APIs

• Monitor and support data pipelines and ETL workflows

• Cloud (Azure) infrastructure administration: network configurations, access and permissions, cloud services

• Oversee, participate in and manage production deployments.

• Interface with global vendor and internal teams.

• Ensure cloud environment reliability, availability, performance and security

• Define and implement monitoring and alerting for cloud infrastructure and applications

• Coordinate recovery from incidents utilizing well defined operational procedures, tools, and efficient communication across internal and external stakeholders.

• Actively use and suggest improvements to continuous delivery toolset.

Requirements:

•  3+ years (or educational equivalent) building data pipelines using Azure data tools and services (Azure Data Factory, Azure Databricks, Azure Function, Spark, Azure Blob/ADLS, Azure SQL, Snowflake..)

• 2+ years and a proven record of success in Azure administration

• 3+ years and a proven record of success in monitoring cloud infrastructure, applications, big data pipelines and ETL workflows

• Experienced in managing outages, customer escalations, crisis management, and other similar circumstances.

• Proficient with DevOps tools and environments like Azure DevOps, Jenkins, Gitlab, Ansible, Terraform.

• Proficient in SQL, Spark SQL, Python, PySpark

• Familiarity with agile software delivery methodologies

• Knowledge of Digital Marketing (Email, Search-Engine Marketing, Social, Affiliate) or eCommerce