Must have:
- Strong understanding of Spark in implementing Batch and Streaming ETL pipelines.
- In depth knowledge of Scala and Java programming, good understanding of Data structures and algorithms.
- API development experience using Java Spring Boot.
- Knowledge of Microservice architecture and design patterns.
- Good exposure to AWS cloud services.
- Experience working with SQL and NoSQL.
- Implementing scalable data pipelines using parallel distributed framework like Spark with Scala , Java.
- Microservice application development, API development with Java Spring boot.
Good to have:
Hive, Kubernetes (Spark on Kubernetes), Docker