Description

Key Skills: Adb, Azure Databricks, Azure, Python, Spark

Roles and Responsibilities:

  • Develop and maintain data processing systems using Azure Databricks and other Big Data technologies.
  • Lead the design and implementation of scalable data solutions, ensuring high performance and reliability.
  • Collaborate with cross-functional teams to integrate data from various sources, including RDBMS and NoSQL databases.
  • Utilize Apache Spark for data processing and performance tuning of Spark jobs.
  • Implement stream-processing systems using technologies such as Apache Storm or Spark-Streaming.
  • Manage messaging systems like Kafka or RabbitMQ for efficient data flow.
  • Conduct performance tuning and optimization of data queries and processes.
  • Apply Agile methodologies to enhance project delivery and team collaboration.
  • Mentor and lead junior team members in best practices and technical skills.

Skills Required:

  • Azure Data Engineering (Azure Databricks, ADB)
  • Distributed Data Processing (Apache Spark)
  • Data Integration (RDBMS & NoSQL)
  • Stream Processing (Spark-Streaming, Storm)
  • Messaging Systems (Kafka, RabbitMQ)
  • Performance Tuning & Optimization
  • Agile Development Practices

Education: Bachelor's degree in Computer Science, Information Technology, or a related field

 


 

Key Skills
Education

Any Graduate

Back To Jobs