Luma AI, Inc.

Staff Software Engineer - Data infrastructure

Palo Alto, CA, US

Onsite
Full-time
$200k–$300k/year
9 months ago
Save Job

Summary

We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing. You'll be part of Luma's applied research team and work directly on mission critical work-streams utilizing thousands of GPUs. Responsibilities * Design, build and automate infrastructure for processing data across multiple clusters of thousands of GPUs. * Work with researchers to identify and implement technical data requirements, and optimize distributed loading for model training. * Work cross-functionally for diverse backend engineering needs. * Design & build performant infrastructure to manage and leverage large-scale datasets for our model training. Experience * Requirement of 10+ years of engineering, including 2+ years of work experience in petabyte-level data processing. * Very strong generalist python coding. * Experience engineering large-scale systems that process and serve petabytes of data. * Deep understanding of Kubernetes, SLURM, Ray and other cluster orchestration systems. * Experience working with visual data. * Experience working closely with ML is a strong plus . Compensation * The pay range for this position in California is $200,000 - $250,000yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan. $250,000 - $300,000 a year The pay range for this position in California is $200,000 - $300,000yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan. All your applications are reviewed by real people.

How strong is your resume?

Upload your resume and get feedback from our expert to help land this job