Extensive experience in validating ETL processes, ensuring accurate data extraction, transformation, and loading across multiple environments.
Proficient in Java programming, with the ability to understand and write Java code when required.
Advanced skills in SQL for data validation, querying databases, and ensuring data consistency and integrity throughout the ETL process.
Expertise in utilizing Unix commands to manage test environments, handle file systems, and execute system-level tasks.
Proficient in creating shell scripts to automate testing processes, enhancing productivity and reducing manual intervention.
Ensuring that data transformations and loads are accurate, with strong attention to identifying and resolving discrepancies in the ETL process.
Focused on automating repetitive tasks and optimizing testing workflows to increase overall testing efficiency.
Write and execute automated test scripts using Java to ensure the quality and functionality of ETL solutions.
Utilize Unix commands and shell scripting to automate repetitive tasks and manage system processes.
Collaborate with cross-functional teams, including data engineers, developers, and business analysts, to ensure the ETL processes meet business requirements.
Ensure that data transformations, integrations, and pipelines are robust, secure, and efficient.
Troubleshoot data discrepancies and perform root cause analysis for failed data loads.
Create comprehensive test cases, execute them, and document test results for all data flows.
Actively participate in the continuous improvement of ETL testing processes and methodologies.
Experience with version control systems (e.g., Git) and integrating testing into CI/CD pipelines.
Tools & Technologies (Good to Have):
Experience with Hadoop ecosystem tools such as HDFS, MapReduce, Hive, and Spark for handling large-scale data processing and storage.
Knowledge of NiFi for automating data flows, transforming data, and integrating different systems seamlessly.
Experience with tools like Postman, SoapUI, or RestAssured to validate REST and SOAP APIs, ensuring correct data exchange and handling of errors.
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job