Job Description

Accountabilities:

The role focuses on validating data solutions, ensuring pipeline accuracy, and supporting continuous improvements across data testing processes. Key responsibilities include:

• Validate data within Databricks Delta tables across Bronze, Silver, and Gold data layers.
• Perform source-to-target reconciliation and verify data completeness, consistency, and accuracy.
• Test data transformations, business rules, aggregation logic, and pipeline workflows.
• Execute advanced SQL queries to validate datasets, schemas, data types, null values, duplicate records, and key constraints.
• Perform regression, integration, and end-to-end testing for data pipelines and data processing workflows.
• Create, maintain, and execute test cases and scenarios based on business requirements.
• Track, document, and manage defects using JIRA while collaborating with engineering teams on resolutions.
• Participate in Agile ceremonies, including sprint planning, stand-ups, and retrospectives.
• Prepare test execution reports and communicate testing progress, findings, and risks to stakeholders.
• Support data quality initiatives through validation frameworks and continuous improvement practices.

Requirements:

The ideal candidate brings strong experience in data testing, Databricks environments, and quality assurance practices, along with excellent analytical and communication skills. Required qualifications include:

• 3–5 years of experience in Data Testing, ETL Testing, or Data Validation roles.
• Hands-on experience with Databricks and Delta Lake validation.
• Strong SQL skills for data validation, reconciliation, and troubleshooting.
• Experience testing ETL/ELT pipelines and validating complex data transformations.
• Knowledge of Spark SQL and Databricks notebooks.
• Experience using JIRA for defect tracking and test management.
• Understanding of data warehousing concepts, relational databases, and data quality principles.
• Experience working within Agile/Scrum delivery environments.
• Strong problem-solving, analytical thinking, and stakeholder communication skills.
• Preferred experience with PySpark, Python, Azure Databricks, Azure DevOps, Git, data quality frameworks, or test automation tools.

Benefits:

• Contract opportunity with a fully remote working environment in India.
• Opportunity to work on modern cloud data platforms and enterprise-scale data solutions.
• Exposure to Databricks, Delta Lake, Spark technologies, and advanced data engineering practices.
• Collaborative Agile environment with opportunities to work alongside experienced technical teams.
• Professional growth through hands-on experience with impactful data projects.
• Competitive compensation package aligned with experience and skills.