Responsibilities

• Lead and mentored a team of Python developers.
• Design, develop, and maintain highly scalable data processing applications.
• Write efficient, reusable, and well-documented code.
• Deliver big data projects using Spark, Scala, Python, SQL, HQL, and Hive.
• Leverage data pipelining application to package work.
• Maintain and tune existing Hadoop applications.
• Work closely with QA, Operations, and various teams to deliver error-free software on time.
• Perform code reviews and provide constructive feedback.
• Actively participate in daily agile / scrum meetings.
• Design, develop, and maintain highly scalable data processing applications.
• Write efficient, reusable, and well-documented code.
• Deliver big data projects using Spark, Scala, Python, SQL, HQL, and Hive.
• Leverage data pipelining application to package work.
• Maintain and tune existing Hadoop applications.
• Work closely with QA, Operations and various teams to deliver error-free software on time.
• Actively participate in daily agile / scrum meetings.
  
  

Requirements

• 7+ years of software development experience with Hadoop framework components(HDFS, Spark, PySpark, Sqoop, Hive, HQL, Spark, Scala).
• Experience in a leadership or supervisory role.
• 4+ years of experience using Python, SQL, and shell scripting.
• Experience in developing and tuning spark applications.
• Excellent understanding of spark architecture, data frames, and tuning spark.
• Strong knowledge of database concepts, systems architecture, and data structures is a must.
• Process-oriented with strong analytical and problem-solving skills.
• Excellent written and verbal communication skills.
• Bachelor's degree in Computer Science or related field.
• 5+ years of software development experience with Hadoop framework components(HDFS, Spark, PySpark, Sqoop, Hive, HQL, Spark, Scala).
• 4+ years of experience using Python, SQL, and shell scripting.
• Experience in developing and tuning spark applications.
• Excellent understanding of spark architecture, data frames, and tuning spark.
• Strong knowledge of database concepts, systems architecture, and data structures is a must.
• Process-oriented with strong analytical and problem-solving skills.
• Excellent written and verbal communication skills.
• Bachelor's degree in Computer Science or related field.
  
  

This job was posted by Manisha Rani from Amantya Technologies.