Roles & Responsibilities:
Strong experience in design data solutions using data platforms Cloudera/any data lake, Confluent/Apache Kafka, Azure Data services like ADF, Spark/ Databricks, Cosmos DB, Data modelling with NoSQL Databases i.e. MongoDB or any document NoSQL db.
Experience in design data models and architectures optimized for high performance, scalability, and fast response times, particularly in NoSQL databases (Cosmos DB/ MongoDB / any Document DB ).
Implement data solutions that ensure data accuracy, integrity, consistency, scalable, reliable etc.
Collaborate with stakeholders to understand data requirements and design effective data architecture.
Recommend the best tools and practices to build batch and streaming data pipelines.
Manage capacity planning and cost optimization for Azure services to ensure efficient and cost effective use of cloud resources.
Define data governance policies to ensure data quality and security across data layers.
Provide direction, review and mentorship to Data Engineers, assisting with pipeline design, optimization, and troubleshooting as needed to ensure alignment with data architecture standards.
Strong communication skills to collaborate across teams and translate business needs into data solutions.
Bachelor's degree in Computer Science