Location: Pune / Indore / Bangalore / Noida

Job Title: Big Data Engineer

Job Description:

Key Technical Skills (Must-Have & Good-to-Have):

• 2-4 years of professional experience
• Expertise and hands-on experience with Python – Must Have
• In-depth knowledge of SparkQL / Spark DataFrame – Must Have
• Strong understanding of SQL – Good to Have
• Experience with Shell scripting – Good to Have
• Knowledge of workflow engines such as Oozie, Autosys – Good to Have
• Familiarity with Agile development methodologies – Good to Have
• Understanding of Cloud technologies – Good to Have
• Passion for exploring new technologies – Good to Have
• Approach to Automation – Good to Have

Roles & Responsibilities:

The selected candidate will be responsible for Data Warehouse modernization projects, including:

• Developing programs/scripts using Python/Java combined with SparkSQL/Spark DataFrame or Python/Java + Cloud-native SQL (e.g., RedshiftSQL, SnowSQL).
• Script validation and ensuring optimal performance.
• Performance tuning of data processes.
• Data ingestion from source to target platforms.
• Job orchestration.

Experience Required: 2 to 4 years

Education/Qualification: BE / B.Tech / MCA / M.Tech / M.Com