Company: Nebula Tech Solutions

Location: Remote (India-based)

Client: Leading U.S.-based E-Commerce Company

Work Model: Remote, Collaborating with a Global Team

Experience Required: 3–5 Years

Are you a seasoned Data Engineer who thrives in building and scaling real-time streaming architectures? We're looking for an expert who can own our Kafka infrastructure and drive mission-critical data workflows.

🔍 What We’re Looking For:

Tech Stack & Skills

• ✅ 5+ years of experience with Python
• ✅ 5+ years working with Debezium Kafka connectors for SQL Server
• ✅ 5+ years of hands-on Kafka experience (preferably deployed on Kubernetes)
• ✅ 3+ years with Kubernetes and Docker
• ✅ Proven experience with Kafka upgrades, cluster tuning, and MirrorMaker for replication
• ✅ Familiar with DevOps practices, networking, and collaboration with SRE teams
• ✅ Solid grasp of distributed systems and real-time streaming architectures
• ✅ Experience with AWS tools: Lambda, Step Functions, Athena, S3, DMS
• ✅ Proficient with Helm Charts, Kustomize, and Git
• ✅ Strong SQL and familiarity with SQL Server, PostgreSQL, MongoDB, DynamoDB
• ✅ Strong understanding of CI/CD pipelines
• ✅ Experience testing pipelines and infra components at scale

🛠️ Key Responsibilities

• Monitor Kafka logs and clusters; resolve issues proactively
• Analyze logs using Grafana/OpenSearch to identify performance improvements
• Create and manage Kafka Source/Sink connectors
• Integrate new Kafka connectors into the platform
• Own and document connector lifecycle via Jira
• Define and run integration/system test cases for pipelines
• Communicate alerts/incidents clearly and promptly
• Provide consistent daily task updates
• Drive automation projects (e.g., Kafka connector provisioning)

🧠 This is a role for someone who thrives in high-impact environments and wants to shape the future of platform engineering.

💼 Location: Remote (India)

🕐 Join Time: Immediate