Job Title: Senior Data Engineer (Azure, Python, Databricks)

Location: Pune Job Type: Full-time

Experience: 3 – 6 years

About Us: Atyeti is a US based IT services provider with global offices in Singapore, Malaysia, Hong Kong, Philippines, North Carolina, Raleigh, and India- Pune, Hyderabad, Trivandrum, Chennai & Bengaluru. We work within the Investment Banking domain with clients such as HSBC, Morgan Stanley, JP Morgan, Credit Suisse, Citi, BOA, to name a few.

For more information, please visit www.atyeti.com .

Job Summary

We are looking for a highly skilled Senior Data Engineer with expertise in Azure, PySpark, Databricks, and data engineering.

The ideal candidate will have experience in designing and implementing scalable data pipelines, working with large datasets, and collaborating with cross-functional teams. Key

Responsibilities

• Design, develop, and deploy scalable data pipelines using Azure Data Factory, PySpark, and Databricks
• Work with large datasets, ensuring data quality, integrity, and security
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver insights
• Develop and maintain data warehousing solutions, ensuring data is properly structured and accessible
• Implement data governance policies, ensuring data compliance and security
• Stay up to date with industry trends, emerging technologies, and best practices in data engineering
  
  

Requirements

• 5-7 years of experience in data engineering, with a focus on Azure, PySpark, and Databricks
• Strong expertise in Azure Data Factory, PySpark, Databricks, SQL, and Python
• Experience working with large datasets, ensuring data quality, integrity, and security
• Strong understanding of data warehousing concepts, including data modelling, ETL, and data governance
• Experience with cloud-based data platforms, such as Azure Synapse Analytics
• Effective communication and collaboration skills, with experience working with cross functional teams
• Bachelor’s degree in computer science, Engineering, or a related field