MLOPS / Data Architect

What we look for:

* Minimum qualifications:

* Educational Background: Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience).

* Experience: 4+ years of experience as a Data Engineer, with proficiency in at least two major cloud platforms (AWS, Azure, GCP).

* Proven experience in designing, developing, and implementing comprehensive data engineering solutions using Databricks, specifically for large-scale data processing and integration projects.

* Demonstrated expertise in developing scalable streaming and batch solutions using cloud-native components.

* Proven ability to perform data transformation tasks, including cleansing, aggregation, enrichment, and normalization, utilizing Databricks and related technologies.

* Experience in applying DataOps principles and implementing CI/CD and DevOps practices within data environments to optimize development and deployment workflows.

* Technical Skills:

* Expert-level proficiency in Spark Scala, Python, and PySpark.

* In-depth knowledge of data architecture, including Spark Streaming, Spark Core, Spark SQL, and data modeling.

* Hands-on experience with various data management technologies and tools, such as Kafka, StreamSets, and MapReduce.

* Proficient in using advanced analytics and machine learning frameworks, including Apache Spark MLlib, TensorFlow, and PyTorch, to drive data insights and solutions.

* Databricks Specific Skills:

* Extensive experience in data migration from on-premises to cloud environments and in implementing data solutions on Databricks across cloud platforms (AWS, Azure, GCP).

* Skilled in designing and executing end-to-end data engineering solutions using Databricks, focusing on large-scale data processing and integration.

* Proven hands-on experience with Databricks administration and operations, including notebooks, clusters, jobs, and data pipelines.

* Experience integrating Databricks with other data tools and platforms to enhance overall data management and analytics capabilities.

* Preferred qualifications:

* Certifications:

* Certification in Databricks Engineering (Professional)

* Microsoft Certified: Azure Data Engineer Associate

* GCP Certified: Professional Google Cloud Certified.

* AWS Certified Solutions Architect Professional