Responsibilities

• Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases
• Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis
• Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions
• Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques
• Optimize data processing workflows for maximum performance and efficiency
• Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems
• Implement best practices for data governance, security, and compliance
• Document technical designs, processes, and procedures to support knowledge sharing across teams
  
  
  

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 4+ years of experience as a Big Data Engineer or in a similar role
• Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks
• Extensive experience with programming languages such as Python, Scala, or Java
• Knowledge of data modeling and data warehousing concepts
• Familiarity with NoSQL databases like Cassandra or MongoDB
• Proficient in SQL for data querying and analysis
• Strong analytical and problem-solving skills
• Excellent communication and collaboration abilities
• Ability to work independently and effectively in a fast-paced environment
  
  
  

Benefits

Competitive salary and benefits package.

Opportunity to work on cutting-edge technologies and solve complex challenges.

Dynamic and collaborative work environment with opportunities for growth and career advancement.

Regular training and professional development opportunities.