Important Information

Location: Pune

Experience: 6+ to 9 years of work experience

Job Mode: Full-time

Job Summary

As a Senior Data Engineer, you will be a key member of our data team, responsible for developing and maintaining infrastructure and pipelines. You will collaborate with cross-functional teams to support data-driven decision-making and contribute to the growth and success of our data-driven initiatives.

This is a key role for an experienced engineer who thrives in developing high-performance, scalable, secure, and resilient data systems using AWS cloud-native services, Python, and a mix of relational and non-relational databases. This position offers the opportunity to work with the latest cloud technologies, while also supporting and modernizing legacy on-prem systems built with Microsoft technologies. You should be passionate about crafting modern data architectures and working across the full data lifecycle—from ingestion to modeling to storage and access.



Key Responsibilities:

•   Architect, develop, and maintain high-throughput, fault-tolerant data pipelines using Python and AWS services such as AWS Glue, Lambda, Kinesis, Step Functions, and S3.
•   Design and optimize data models for both structured (relational) and semi/unstructured (non-relational) data, using databases such as Amazon RDS, Aurora, DynamoDB, and Microsoft SQL Server (on-prem).
•   Develop and integrate robust data ingestion solutions using REST APIs, messaging systems (SNS/SQS/Kinesis), and file-based ingestion.
•   Collaborate with product and analytics teams to gather requirements and build data solutions that are scalable and maintainable.
•   Implement data quality, lineage, and validation checks to ensure reliable data delivery.
•   Lead efforts to migrate on-prem workloads to cloud-native solutions on AWS.
•   Provide technical mentorship and guidance to junior team members and foster best practices in coding, testing, and operations.
  
  

Qualifications:

•   Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
•   5+ years of experience in Data Engineering or similar roles, with a strong emphasis on cloud-native architectures.
•   Deep expertise in Python for backend data processing, scripting, and automation.
•   Strong hands-on experience with a broad range of AWS data services, such as:
  
  

o  AWS Glue, Lambda, Step Functions, Kinesis, Athena, Redshift, S3, RDS, DynamoDB

•   Solid understanding of relational databases (e.g., PostgreSQL, MySQL, SQL Server) and non-relational databases (e.g., DynamoDB, MongoDB, Elasticsearch).
•   Proficiency in REST API development and integration, including security, authentication, and performance tuning.
•   Strong knowledge of CI/CD pipelines, infrastructure-as-code (IaC), and version control (e.g., Git).
•   Excellent debugging, analytical, and communication skills.
  
  

Preferred Skills:

•   Experience with big data tools such as Apache Spark, Hadoop, or EMR.
•   Familiarity with data cataloging, data governance, and data lake patterns.
•   Exposure to containerized environments (Docker, ECS, EKS) and orchestration.
•   Experience working with monitoring and alerting tools such as CloudWatch, Datadog, or Prometheus.
  
  

Nice to Have:

•   Certifications in AWS (e.g., AWS Certified Data Analytics, Solutions Architect) or related disciplines.
•   Familiarity with data visualization and reporting tools such as QuickSight, Power BI, or Tableau.
  
  
  
  

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world's leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora's technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.