Data testing ETL

Job Description

Overview :

We are seeking a detail-oriented Data Tester to join our offshore team for a metadata-driven settlement rule engine implementation on the cloud platform. The ideal candidate will be responsible for testing data pipelines, validating metadata configurations, and ensuring the accuracy and performance of the settlement rule engine. This role requires strong analytical skills, technical expertise, and hands-on experience in testing data platforms.

Responsibilities:

o Understand business and technical requirements for the metadata-driven settlement rule engine.

o Design, develop, and document test cases and scenarios for data validation, metadata accuracy, and rule execution.

o Perform functional, integration, and regression testing for data pipelines and rule engine functionalities.

o Validate data accuracy, rule execution results, and metadata configurations against expected outcomes.

o Execute tests on cloud components such as Glue, and Lambda and .

o Identify, log, and track defects using standard tools (e.g., JIRA, Azure Devops, HP ALM).

o Collaborate with developers and onshore teams to resolve defects and validate fixes.

o Use SQL queries to validate data across various stages of the pipeline and in data warehouses.

o Verify that settlement rules are processed correctly based on metadata-driven configurations.

o Validate the access & ability of data updates using CRUD screens

o Validate inbound & outbound extracts against data contracts & Requirements

o Work closely with the onshore test lead and other team members to ensure alignment with project goals and timelines.

o Provide regular updates on test progress, issues, and risks.

o Assist in developing and executing automated test scripts for repetitive testing tasks such as Regression , Sanity.

o Identify areas for automation to improve efficiency and coverage.

Required Skills:

o Hands-on experience in testing data pipelines, ETL processes, and data warehouses.

o Experience in writing complex SQL queries.

o Familiarity with Cloud databases such as Postgres, Redshift, Synapse

o Experience with metadata-driven systems and rule engines is a plus.

o Experience with test management tools (e.g., JIRA, HP ALM).

o Excellent attention to detail and analytical skills.

o Strong communication and collaboration skills to work effectively in a distributed team.

o Ability to prioritize tasks and meet deadlines in a fast-paced environment.

o Ability to analyse and identify root cause.

o Experience in Pyspark scripting is an added advantage.

Education and Experience:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.