Data Engineer

Job Overview:

TCS is looking for skilled and experienced Data Engineers to join our dynamic team in Pune. In this role, you will be responsible for building, managing, and optimizing data pipelines, ensuring efficient data processing and storage, and collaborating with cross-functional teams to develop data solutions that support business intelligence and analytics initiatives.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines for processing large datasets.
• Manage and optimize data storage solutions, ensuring data is readily available and can be accessed efficiently for analytics and reporting purposes.
• Work with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Synapse Analytics, and Functions to build cloud-based data platforms.
• Apply technical expertise to develop data models, implement data mining techniques, and support data analytics and segmentation.
• Use SQL and programming languages such as Python, Java, Scala, R, and .NET/C# to manipulate data and build reliable data pipelines.
• Collaborate with other engineering teams to ensure that the architecture and data flow meet business requirements.
• Design and manage ETL processes, ensuring the efficient extraction, transformation, and loading of data.
• Support data warehousing and reporting needs to deliver actionable insights to business stakeholders.

Must-Have Skills:

• Proven experience as a Data Engineer or in a similar role with a strong background in managing large datasets.
• In-depth knowledge and hands-on experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Synapse Analytics, and Azure Functions.
• Expertise in data models, data mining, analytics, and segmentation techniques.
• Strong programming skills with proficiency in languages such as Python, Java, Scala, R, and .NET/C#.
• Hands-on experience with SQL database design and development.
• Excellent numerical and analytical skills to identify trends, patterns, and actionable insights from data.
• Degree in Computer Science, Information Technology, or a related field (Master’s degree is a plus).
• Strong understanding of ETL processes and data integration techniques.

Good-to-Have Skills:

• Experience with Django or similar web frameworks.

Qualifications:

• Experience: 10+ years in Data Engineering or similar roles, with a strong focus on data processing, storage, and analysis.
• Educational Background: Bachelor’s degree in Computer Science, IT, or a related field. Master’s degree is a plus.