Work with product managers and development leads to create testing strategies

• Develop and scale automated data validation framework
• Build and monitor key metrics of data health across the entire Big Data pipelines
• Early alerting and escalation process to quickly identify and remedy quality issues before something ever goes ‘live’ in front of the customer
• Build/refine tools and processes for quick root cause diagnostics
• Contribute to the creation of quality assurance standards, policies, and procedures to influence the DQ mind-set across the company Required skills and experience:
• Solid experience working in Big Data ETL environments with Spark and Java/Scala/Python
• Strong experience with AWS cloud technologies (EC2, EMR, S3, Kinesis, etc)
• Experience building monitoring/alerting frameworks with tools like Newrelic and escalations with slack/email/dashboard integrations, etc
• Executive-level communication, prioritization, and team leadership skills Skills:- Informatica Data Quality, Data governance, Data engineering, Big Data, ETL, Spark, Java, Scala and Python