Company: Global Technology organization

Key Skills: SCALA, Database, Apache Spark, Big Data, Data Engineer, Spark

Roles and Responsibilities:

• Lead technical initiatives and contribute as a senior team member to achieve project goals and deadlines.
• Collaborate with team members to design, implement, and optimize software solutions aligned with organizational objectives.
• Build scalable, efficient, and high-performance pipelines and workflows for processing large amounts of batch and real-time data.
• Perform multidisciplinary work, supporting real-time streams, ETL pipelines, data warehouses, and reporting services.
• Recommend and advocate for technology upgrades to company leaders to ensure infrastructure remains robust and competitive.
• Design and develop microservices and data applications while ensuring seamless integration with other systems.
• Leverage Big Data technologies like Kafka, AWS S3, EMR, and Spark to handle data ingestion, transformation, and querying.
• Follow coding best practices, including unit testing, code reviews, code coverage, and maintaining comprehensive documentation.
• Conduct thorough code reviews to maintain quality, mentor junior team members, and promote continuous learning within the team.
• Enhance system performance through analysis and capacity planning, ensuring efficient and reliable software releases.
• Actively bring new and innovative solutions to address challenging software issues that arise throughout the product lifecycle.
• Implement and promote security protocols and data governance standards across development projects.
• Actively engage in Agile processes to foster collaboration and innovation within the team.

Skills Required:

• Strong software design capabilities with a deep understanding of design patterns and performance optimizations.
• Proficiency in writing high-quality, well-structured code in Java and Scala.
• Expertise in SQL and relational databases, with advanced skills in writing efficient, complex queries and optimizing database performance.
• Expertise in cloud computing infrastructure, particularly AWS (Aurora MySQL, DynamoDB, EMR, Lambda, etc.).
• Solid experience with Big Data tools such as Apache Spark and Kafka.
• Ability to clearly document and communicate technical solutions to diverse audiences.
• Experience mentoring and conducting constructive code reviews to support team development.
• Familiarity with Agile methodologies and modern development tools.
• 10+ years' experience in designing and developing enterprise level software solutions
• 3 years' experience developing Scala / Java applications and microservices using Spring Boot
• 7 years' experience with large volume data processing and big data tools such as Apache Spark, SQL, Scala, and Hadoop technologies
• 5 years' experience with SQL and Relational databases
• 2 year Experience working with the Agile/Scrum methodology

Preferred qualifications

• Knowledge in advanced database technologies like SingleStore DB and SnowFlake
• Educational domain background

Education: Bachelor's Degree in related field