AWS Glue Data Pipeline Tester

ProArch

. Define and validate data quality rules covering completeness, accuracy, consistency, validity, uniqueness, timeliness, referential integrity, conformity to business rules, and schema and metadata consistency.

Posted 10/6/2026contractChennai • IndiaMid-LevelSenior💰 ₹1,800,000 - ₹2,200,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in data quality validation, testing methodologies, and AWS services, ensuring robust data pipeline and file processing integrity. Proficient in performing various testing types, including functional, integration, and performance testing, to support data-driven decision-making.

Highest-signal resume keywords

AWS Glue JobsAWS Glue WorkflowsData Pipeline TestingInbound/Outbound File ProcessingFunctional Testing

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Quality RulesFunctional TestingEnd-to-End Integration TestingData Validation TestingSource-to-Target ReconciliationRegression TestingSystem Integration TestingPerformance TestingSecurity TestingOperational Validation

Tools & Technologies

Amazon S3Amazon CloudWatchAWS IAMAmazon EventBridgeAWS LambdaAmazon SNSAmazon SQSAWS Secrets ManagerAWS Step FunctionsAWS KMS

Industry Keywords

Data PipelineFile Processing Interface TestingInbound/Outbound Data File ProcessingTesting MethodologiesData Transfer Validation

Tech Stack

Tools & technologies

AWS

About the role

Key responsibilities & impact

Define and validate data quality rules covering completeness, accuracy, consistency, validity, uniqueness, timeliness, referential integrity, conformity to business rules, and schema and metadata consistency.
Perform functional testing.
Perform end-to-end integration testing.
Perform data validation testing.
Perform source-to-target reconciliation.
Perform parallel testing with legacy interfaces.
Perform regression testing.
Perform system integration testing.
Support user acceptance testing.
Perform negative testing.
Perform exception and error-path testing.
Perform performance and volume testing.
Perform scalability testing.
Perform restart and recovery testing.
Perform failover and resiliency testing.
Perform security and access testing.
Perform production smoke testing.
Perform operational and monitoring validation.

Requirements

What you’ll need

AWS Glue Jobs
AWS Glue Workflows
Amazon S3
Amazon CloudWatch
AWS IAM
Amazon EventBridge
AWS Lambda
Amazon SNS
Amazon SQS
AWS Secrets Manager
AWS Step Functions
AWS KMS
Ability to review AWS Console configurations, job parameters, logs, metrics, and execution history.
Data Pipeline and File Processing Interface Testing
Strong understanding of Inbound and Outbound Data File Processing / Data Pipeline.
Experience testing inbound/outbound file transfers across S3, SFTP/FTPS, AWS Transfer Family, APIs, and external partner endpoints, including authentication, connectivity, retry, timeout, and delivery validation.