Key Skills: Python, SQL, Selenium, JIRA, Excel/VBA, AWS (Redshift, S3, Glue), Git, CodeCommit, Qlik/Tableau/PowerBI, Statistical Tools, Machine Learning, Deep Learning, Gen AI, Operations Research, Ms Sql, Tableau
Roles and Responsibilities:
- Design, develop, and maintain scalable data pipelines using AWS services.
- Automate data pipeline deployments, troubleshoot and resolve data pipeline issues, ensuring high availability and performance.
- Build and optimize ETL/ELT processes to ingest, transform, and load data from various sources into target systems on AWS.
- Design, develop, and maintain robust and scalable web automation scripts using Selenium or similar tools to automate repetitive tasks (of business operations team) across various web applications.
- Collaborate with business stakeholders to understand data requirements and deliver solutions that meet requirements.
- Develop and implement Jira workflows (with help from Atlassian partner vendors where required), including creating and configuring transitions, statuses, and automations to streamline processes. Integrate web automation scripts with Jira workflows to trigger automated actions based on issue status changes or other events.
- Build / Integrate APIs with MS Teams or Web Frontend for recurring requests.
- Enable self-serve analytics across the organization, explore and implement Gen AI capabilities that can lead to innovative solutions for the organization.
- Optimize data storage, retrieval, and deployment strategies for performance and cost-effectiveness in AWS. Utilize AWS data services such as S3, Glue, Lambda, Step Functions, Kinesis, Redshift, and RDS to construct efficient data workflows.
- Maintain code and query repositories using Git or CodeCommit, ensuring proper version control and providing comprehensive documentation for all code and queries.
Experience Requirement:
- 3-8 years of overall experience with demonstrated success in managing and deploying scalable data pipelines on AWS.
- Extensive hands-on experience with Python, SQL, and web automation using Selenium.
- Proven ability to create and automate Jira workflows and integrations with MS Teams and other applications.
- Strong exposure to AWS ecosystem including Redshift, S3, Glue, Lambda, and Step Functions.
- Experience in enabling self-serve analytics using BI tools (Qlik, Tableau, Power BI).
- Experience implementing Gen AI capabilities and statistical modeling for business optimization is a strong plus.
- Hands-on experience maintaining version-controlled repositories in Git/CodeCommit and working within CI/CD frameworks.
Education: B.Tech