BlueCloud

BlueCloud - Senior Data Platform Engineer - Spark/Python

Pune, MH, IN

15 days ago
Save Job

Summary

Key Responsibilities

  • Data Pipeline Architecture : Build and optimize large-scale data ingestion pipelines from multiple sources.
  • Scalability & Performance : Ensure low-latency, high-throughput data processing for real-time and batch workloads.
  • Cloud Infrastructure : Design and implement cost-effective, scalable data storage solutions.
  • Automation & Monitoring : Implement observability tools for pipeline health, error handling,

and performance tracking.

  • Security & Compliance : Ensure data encryption, access control, and regulatory compliance in the data platform.

Ideal Candidate Profile

  • Strong experience in Snowflake, dbt, and AWS for large-scale data processing.
  • Expertise in Python, Airflow, and Spark for orchestrating pipelines.
  • Deep understanding of data architecture principles for real-time and batch workloads.
  • Hands-on experience with Kafka, Kinesis, or similar streaming technologies.
  • Ability to work on cloud cost optimizations and infrastructure-as-code (Terraform, CloudFormation).

(ref:hirist.tech)

How strong is your resume?

Upload your resume and get feedback from our expert to help land this job