Big Data Developer

Description
We are seeking an experienced Big Data Developer to join our team at Binary Infoways. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems. You will work closely with our data science team to identify business requirements and develop solutions to meet those needs. Your expertise in - AWS (EMR, S3, Glue, Airflow, RDS, Dynamodb, similar) CICD (Jenkins or another) Relational Databases experience (any) , No SQL databases experience (any),

Mandatory Requirements:

Pyspark

Scala / Java

AWS

Jenkins

Requirement:

Our requirements for this role include:

Minimum6 years of experience and maximum25 years of experience in big data development
Strong knowledge of big data technologies such as Hadoop, Spark, and NoSQL databases
Experience with programming languages such as Java, Python, or Scala
Strong understanding of data processing and analysis

Role and responsibility:

As a Big Data Developer at Binary Infoways, your roles and responsibilities will include:

Designing, developing, and implementing large-scale data processing systems using big data technologies such as Jenkins and Spark
Collaborating with data scientists to identify business requirements and develop solutions to meet those needs
Ensuring the scalability, reliability, and performance of our data systems
Developing and maintaining large-scale data warehouses and data lakes
Troubleshooting and optimizing data processing workflows to improve efficiency and reduce costs