Data Engineer - Apache Flink Specialist

Contract

Mountain View, CA or Remote

Hybrid option available for Mountain View location

About Company

We are a leading financial software company that provides innovative cloud-based financial management solutions. Our platform helps individuals and businesses manage their finances more effectively through intuitive software tools. With a strong commitment to technological excellence, we're constantly evolving our data infrastructure to support millions of customers worldwide.

Job Description

We have a specific and urgent need to migrate business-critical real-time streaming pipelines written in Apache Flink to a dedicated Kafka infrastructure. Our current infrastructure is hitting its limits, and we need an experienced data engineer to lead this migration effort while ensuring continuous data flow to consumers.

What you'll be responsible for

• Developing, refactoring, and optimizing real-time data processing applications using Apache Flink
• Developing, refactoring, and optimizing batch data processing applications using Apache Spark
• Leading migration of real-time data pipelines to isolated Kafka infrastructure
• Coordinating migration efforts with data consumers
• Providing operational monitoring and on-call support for business-critical applications
• Supporting data consumers with questions related to data issues and consumption patterns
• Participating in on-call rotation (with India team covering off-hours)

Required Experience/Skills

• Minimum 3 years of experience with advanced Apache Flink, building complex real-time processing applications
• Strong experience with Apache Kafka, including monitoring traffic, understanding infrastructure, and consumer management
• Experience with Apache Spark for batch data processing pipelines
• Proficiency in Java, Scala, or Python (Scala preferred)
• Demonstrated experience working with streaming pipelines and high-volume data at scale
• Strong operational background managing all types of streaming pipelines
• Experience developing complex data pipelines from a development perspective

Nice-to-Haves

• Experience with Wavefront monitoring
• Experience helping data consumers troubleshoot performance issues
• Background in financial data processing

Education

• Bachelor's degree in Computer Science, Engineering, or related technical field, or equivalent work experience

Pay & Benefits Summary

• $60.00 - $70.57 per hour
• Contract duration through 10/17/2025 with possibility of extension

Apply Now!

Apache Kafka, Apache Flink, Apache Spark, Java, Scala, Python, Data Engineer, Stream Processing, Real-time Data, Big Data, ETL, Data Migration