Inflection AI

Senior Software Engineer (LLMs, Machine Learning)

Palo Alto, CA, US

30 days ago
Save Job

Summary

Senior Software Engineer (LLMs, Machine Learning)


Inflection AI is a public benefit corporation leveraging our world class large language model to build the first AI platform focused on the needs of the enterprise.


Who we are:


Inflection AI was re-founded in March of 2024 and our leadership team has assembled a team of kind, innovative, and collaborative individuals focused on building enterprise AI solutions. We are an organization passionate about what we are building, enjoy working together and strive to hire people with diverse backgrounds and experience.


Our first product, Pi, provides an empathetic and conversational chatbot. Pi is a public instance of building from our 350B+ frontier model with our sophisticated fine-tuning (10M+ examples), inference, and orchestration platform. We are now focusing on building new systems that directly support the needs of enterprise customers using this same approach.


Want to work with us? Have questions? Learn more below.


About the Role

As a Member of Technical Staff, Senior Software Engineer (LLMs, Machine Learning), you’ll build and maintain backend systems that support our AI platform—from inference pipelines to internal tooling and security infrastructure. Working primarily in Python and TypeScript/Node.js, you’ll play a key role in unblocking critical engineering efforts and delivering reliable, production-grade services. While deep ML knowledge isn’t a must, an understanding of machine learning workflows and a willingness to grow in this space is highly valued.


This role is a strong fit if you:

  • Have backend engineering experience with Python and/or TypeScript/Node.js.
  • Are confident building scalable, maintainable systems that integrate cleanly into complex tech stacks.
  • Like solving backend challenges and want to learn more about ML infrastructure and workflows.
  • Work well independently and collaborate effectively with engineers, researchers, and product teams.
  • Understand how backend reliability directly supports the performance of AI systems in production.


In this role, you will:

  • Build and maintain backend services powering ML inference, data tools, and security layers.
  • Collaborate with cross-functional teams to integrate backend systems with front-end and ML components.
  • Design systems with scalability, observability, and security in mind.
  • Contribute to testing, documentation, and code reviews to maintain engineering quality.
  • Learn continuously about ML systems and share ideas to strengthen platform-level infrastructure.
  • Python, TypeScript, Node.js, backend engineering, inference pipelines, ML workflows, data tooling, secure APIs, scalable systems, enterprise AI, infrastructure, backend services, production systems, machine learning integration

How strong is your resume?

Upload your resume and get feedback from our expert to help land this job