Description

  • 10+ Year experience as Data Engineer with experience in building ETL/Data pipelines with cloud technologies
  • 4+ years extensive experience in designing, developing, and implementing scalable data pipelines using Databricks to ingest, transform, and store structured and unstructured data.
  • 5+ years' experience programming languages such as Python/PySpark and query languages like SQL
  • 5+ years' experience in building metadata driven data ingestion pipelines using ADF
  • 5+ years' experience in analyzing, optimizing, and tuning existing data pipelines for performance, reliability, and efficiency
  • 2+ years' experience in implementing MLOps practices to streamline the deployment and management of machine learning models.
  • 2+ years' experience in utilizing Apache Airflow for job orchestration and workflow management
  • Familiarity with CI/CD tools and practices for automating the deployment of data engineering solutions.
  • Experience in collaborating with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions
  • Knowledge/Experience in implementing security measures and standard processes to ensure data privacy and compliance with regulatory standards
  • In-depth knowledge of data engineering concepts, ETL processes, and data architecture principles

Key Skills
Education

Any Gradute

Back To Jobs