Job Description
Role: Advanced Data Engineer
Tech Stack: Proficiency in Python, SQL, Databricks, Snowflake Data Modeling, ETL process, Apache Spark and PySpark, data integration and workflow orchestration, real time data processing experience/frameworks, Cloud experience (Azure preferred)
Job Description
- Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure]
- Experienced in migrating data from on-prem to cloud-based solution architectures [Azure]
- Extensive experience with Python, Spark and SQL
- Experience in developing ETL processes. Proficient with Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics or equivalent tools and technologies
- Experience building data lakes & data warehouses to support operational intelligence and business intelligence.
- Excellent written and verbal communication skills