Luttechub

Big Data Engineer - Luttechub - Mississauga, ON

Canada

$125k/year
almost 2 years ago
Save Job

Summary

Big Data Engineer Only candidate with years of experience: +8 Those authorized to work in the Canada are encouraged to apply. Onsite, Mississauga, Canada Skill set:- Bigdata+ Spark +pyspark + Scala + python Qualifications : · 8+ years of software development experience in Big Data technologies (Spark/Hive/Hadoop) · Experience in working on Hadoop Distribution, good understanding of core concepts and best practices · Good experience in building/tuning Spark pipelines in Scala/Python · Good experience in writing complex Hive queries to derive business critical insights · Good Programming experience with Java/Python/Scala · Experience with AWS Cloud, exposure to Lambda/EMR/Kinesis will be good to have · Experience in NoSQL Technologies - MongoDB, Dynamo DB Roles and Responsibilities : · Design and implement solutions for problems arising out of large-scale data processing · Attend/drive various architectural, design and status calls with multiple stakeholders · Ensure end-to-end ownership of all tasks being aligned · Design, build & maintain efficient, reusable & reliable code · Test implementation, troubleshoot & correct problems · Capable of working as an individual contributor and within team too · Ensure high quality software development with complete documentation and traceability · Fulfil organizational responsibilities (sharing knowledge & experience with other teams/ groups) · Conduct technical training(s)/session(s), write whitepapers/case studies/blogs etc. Job Type: Full-time Pay: $120,000.00-$125,000.00 per year Schedule: 8 hour shift Ability to commute/relocate: Mississauga, ON: reliably commute or plan to relocate before starting work (required) Experience: Big Data technologies (Spark/Hive/Hadoop): 8 years (required) Spark pipelines in Scala/Python: 8 years (required) Java/Python/Scala: 8 years (required) Work Location: In person

How strong is your resume?

Upload your resume and get feedback from our expert to help land this job