Data Engineers:
1. Engineer is strong in scala and spark (both streaming and batch). Not just pyspark, but scala.
2. Proficient in GitLab pipelines and understands concepts behind CI/CD.and GCP
2. Engineer knows how to troubleshoot spark jobs using spark UI.
3. They can provide value right away without any training from us. We cannot afford to spend time training.
Any Graduate