Cloud Data Engineer

Job Summary

Barings has a contractor opening on the Data Engineering team for a Cloud Data Engineer. At Barings we are building a team of technical leaders passionate about emerging technologies and driving our business toward a data centric strategy. As a Senior Cloud Data Engineer, you will be responsible for designing and building data pipelines in a collaborative environment. The right candidate will be experienced in cloud computing best practices using cloud service providers such as Microsoft Azure or GCP or AWS and their tool sets.  Joining the Data Engineering team positions you to contribute to an enterprise wide hybrid cloud transformation.  As such, you must be a self-starter, love learning new concepts, and have the ability to innovate.

Primary Responsibilities

Work with a technology stack including SQL, Python, Databricks Spark, ADF and the Azure Suite

Collaborate with a team to design and build robust and highly automated batch and streaming data pipelines

Discover, introduce, and implement modern cloud technologies into the enterprise domain

Work in cross-functional agile teams to continuously experiment, iterate and deliver on new product objectives.

Qualifications

4-year degree in engineering or computer science or mathematics or related field

5+ years working with cloud platforms such as Microsoft Azure or AWS or GCP

5+ years working experience with SQL and scripting languages such as Python or Scala

3+ years working experience with data pipelines tools like Azure Data Factory/ADF and Databricks or Spark or Dataflow or similar technologies

Working experience with Apache Spark engine

Working experience with Kafka and Steaming technologies

Expert knowledge in developing efficient, robust, and scalable data pipelines

Familiar with modern data lake, data warehousing, and ETL/ELT concepts

Knowledgeable about data modeling, data access, and data storage techniques