We are looking for a Senior Data Engineer to join our dynamic team. The role is a hybrid, full-time position based in Bangalore or Gurgaon. The ideal candidate will have 7 to 10 years of relevant work experience in data engineering.
Qualifications And Skills
Minimum 7 years of work experience in data engineering with a maximum of 10 years.
Expertise in Python (Programming Language) (Mandatory skill).
Proficiency in Linux (Mandatory skill).
Strong experience with SQL (Mandatory skill).
Working knowledge of Hive, understanding the basic concepts and its application in data processing.
Experience with Spark, including data processing and data analytics.
Proficiency in Scala, with an ability to write efficient and scalable code.
Familiarity with modern data engineering tools and frameworks.
Roles And Responsibilities
Design, develop, and maintain scalable data pipelines and systems.
Collaborate with data scientists and analysts to understand data requirements and deliver relevant solutions.
Implement complex data processing algorithms using Python, Linux, and SQL.
Ensure data quality and integrity across different data sources.
Optimize performance of data processing systems and improve their efficiency.
Conduct regular code reviews and provide feedback to junior engineers.
Troubleshoot and resolve data-related issues efficiently.
Stay updated with the latest industry trends and incorporate them into data engineering practices.