Role Description

Job Title: Lead Data Engineer (AWS)

Experience Required: 8–10 Years

Skill: AWS, PySpark, Glue

Location: Pune, Bangalore, Chennai, Hyderabad, Gurgaon, Trivandrum, Kochi

Job Overview

UST is seeking a highly experienced Lead Data Engineer with a strong background in AWS and big data technologies. This role is ideal for a seasoned professional with 8–10 years of experience in data engineering, team leadership, and project management. As a Lead AWS Data Engineer, you will be responsible for architecting scalable data solutions, leading engineering teams, and ensuring alignment with business objectives.

Key Responsibilities

• Provide technical leadership and mentorship to data engineering teams.
• Architect, design, and deploy scalable, secure, and high-performance data pipelines.
• Collaborate with stakeholders, clients, and cross-functional teams to deliver end-to-end data solutions.
• Drive technical strategy and implementation plans in alignment with business needs.
• Oversee project execution using tools like JIRA, ensuring timely delivery and adherence to best practices.
• Implement and maintain CI/CD pipelines and automation tools to streamline development workflows.
• Promote best practices in data engineering and AWS implementations across the team.
  
  

Technical Skills

• Strong hands-on expertise in Python, PySpark, and Spark architecture, including performance tuning and optimization.
• Advanced proficiency in SQL and experience in writing optimized stored procedures.
• In-depth knowledge of the AWS data engineering stack, including:
• AWS Glue
• Lambda
• API Gateway
• EMR
• S3
• Redshift
• Athena
• Experience with Infrastructure as Code (IaC) using CloudFormation and Terraform.
• Familiarity with Unix/Linux scripting and system administration is a plus.
• Proven ability to design and deploy robust, production-grade data solutions.
  

Skills

Aws,Pyspark,Glue