Job Title: Big Data Engineer

Experience: 6+ Years

Location: Gurugram, Chennai, Hyderabad, Bangalore, and Pune

Work Mode: Hybrid

Job Summary:

We're looking for a highly skilled Senior Big Data Engineer with expertise in Spark, Scala, and Azure to join our team. The ideal candidate will have experience in designing and implementing big data solutions using Spark, Scala, and Azure cloud platforms. Strong knowledge of backend development using Java (Spring framework) is also required.

Key Responsibilities:

- Design and develop big data solutions using Apache Spark, Scala, and Azure cloud platforms

- Work with large datasets and develop scalable data pipelines using Spark, Scala, and Azure Data Lake Storage (ADLS)

- Implement data processing and storage solutions using Azure Databricks, Hadoop, and other big data technologies

- Develop backend applications using Java (Spring framework) and integrate with big data solutions

- Collaborate with cross-functional teams to identify and prioritize project requirements

- Troubleshoot and optimize big data solutions for performance and scalability

Requirements:

- 6+ years of experience in big data engineering with strong expertise in Apache Spark, Scala, and Azure cloud platforms

- Strong experience in Azure Data Lake Storage (ADLS), Azure Databricks, and Hadoop

- Proficiency in backend development using Java (Spring framework)

- Experience with big data processing and storage solutions using Spark, Scala, and Azure

- Strong understanding of data architecture, data governance, and data security

- Excellent problem-solving skills and ability to work in a fast-paced environment