Our client in Rochester, NY, is looking to hire a remote Data Processing Engineer.

This is a fully-remote/part-time/3-month contract position (No Third Party Employers please)

Hourly range based on experience: $50-$55/HR

Primary Responsibilities:

• Implement AWS SNS topic as GCP PubSub equivalent
• Convert Apache Beam configurations to AWS Managed Flink for ~16 jobs
• Integrate AWS Managed Flink with AWS Glue
• Configure Glue Data Catalog for processed data storage
• Set up and configure AWS Managed Airflow
• Migrate workflows from Google Composer to AWS MWAA
• Assist with testing and documentation of data processing components
• Support AWS Marketplace integration for data processing aspects

Required AWS Service Skills:

• AWS Managed Flink
• AWS SNS
• AWS Glu
• AWS MWAA (Managed Airflow)
• AWS Lambda
• Amazon CloudWatch
• AWS IAM

Required Technical Skills:

• Python (advanced)
• Terraform
• Apache Beam
• Apache Airflow
• ETL Pipeline Development
• Data Processing
• Streaming Data Architecture

Required Soft Skills:

• Problem-solving
• Team Collaboration
• Technical Documentation
• Communication Adaptability