Job Title: Big Data Engineer / Data Engineer – Azure, PySpark, Big Data Stack

Location: Pune, Hyderabad, Bangalore, Chennai & Noida

Experience: 7+ years

Job Summary:

We are seeking a highly skilled and motivated Big Data Engineer to join our team. The ideal candidate will have hands-on experience with Big Data technologies including HBase, Hive, Airflow, Oozie, and strong programming expertise in Python, PySpark, and Java. Experience with Azure Cloud, Unix/Linux environments, and CI/CD processes is also essential. You'll play a key role in designing, building, and maintaining scalable data pipelines and workflows for enterprise-level data processing.

Key Responsibilities:

• Design and implement robust, scalable, and high-performance data pipelines using PySpark and Big Data tools.
• Develop and maintain workflows using Airflow and Oozie for data ingestion, transformation, and orchestration.
• Work with HBase and Hive for structured and semi-structured data storage and querying.
• Collaborate with data analysts, architects, and stakeholders to gather requirements and deliver solutions.
• Deploy and manage data solutions in Azure Cloud environment.
• Ensure data quality, integrity, and governance across all pipelines.
• Develop scripts and automation using Python and Unix shell scripting.
• Support CI/CD practices for automated deployment and testing.
• Monitor performance and troubleshoot issues in large-scale data environments.

Required Skills & Qualifications:

• 5+ years of experience in Big Data engineering or a related field.
• Strong expertise in PySpark, Python, and Java.
• Hands-on experience with Big Data tools: HBase, Hive, Airflow, Oozie.
• Proficiency in Azure Cloud services related to data (Data Lake, Data Factory, Synapse, etc.).
• Solid understanding of Unix/Linux environments.
• Experience with CI/CD tools like Jenkins, Git, or Azure DevOps.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.

Interested candidates can share their resumes on- [email protected] along with

details in below format.

Name:

Mob no.

Email ID:

Total experience:

Relevant experience:

Current organization:

Current CTC:

Expected CTC:

Notice period:

Current Location:

Preferred Location:

Interview Availability for 26th or 27th Apr: Y/N