Description

  • Meeting with managers to determine the company’s Big Data needs.
  • Pyspark , HDFS, Hive are Must
  • Developing Hadoop systems.
  • Loading disparate data sets and conducting pre-processing services using Hive or Pig.
  • Finalizing the scope of the system and delivering Big Data solutions.
  • Managing the communications between the internal system and the survey vendor.
  • Collaborating with the software research and development teams.
  • Building cloud platforms for the development of company applications.
  • Maintaining production systems.
  • Experience with Kafka
  • Training staff on data resource management.
  • Big Data Engineer Requirements:
  • Previous experience as a big data engineer.
  • In-depth knowledge of Hadoop, Pyspark, Spark, Python and similar frameworks.
  • Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.
  • Hands on experience in Banking
  • Excellent project management skills.
  • Good communication skills.
  • Ability to solve complex networking, data, and software issues.

Key Skills
Education

Any Graduate

Back To Jobs