Data Engineer

Designing and developing efficient ETL processes for data ingestion, integration, and analytics.

Designing and implementing data models, databases, and data warehouses for data storage and analysis.

Need to Establish and maintain technical environment for data analysis, such as databases and data warehouses in cloud environment.

Need to Create and maintain secure data transfer pipelines, including streaming and batch-orientation solutions.

Need to Build solutions for data collection from diversified sources such as APIs, web logs, and files.

Analyze the data quality requirements and design data quality processes.

Need to Monitor data performance issues and to troubleshoot them.

Need to Develop custom scripts to automate data engineering processes.

Need to Design dimensional data models, ETL workflows and SQL queries leveraging a variety of big data technologies.

Need to Configure, deploy, and maintain databases and software technologies used for data engineering processes.

Need to Collaborate with analytics team to identify and prioritize data engineering requirements.

 Involve in Creation of tables, partitioning tables, Join conditions, correlated sub queries, nested queries, views, sequences, synonyms for the business application development.

Need to be involved in writing SQL queries (Sub queries and Join conditions), PL/SQL programming.

Need to Understand the existing business processes and Interacting with Super User and End User to finalize their requirement.