Share this job
ML Infrastructure Engineer
San Francisco, United States
Apply for this job

Series B · ~75 people · $108M raised · Building the ingestion layer to connect human data with machines

San Francisco · In-office, full-time

About the company

The company is a Series B team in San Francisco. The CEO and CTO met at MIT. The company has raised $108M from leading investors.

The machine learning team is eight people and reports to the CTO. It runs a mix of in-house models and larger open-source ones, and an ML tech lead role is expected to be filled around the new year. Engineering is in the office five days a week in San Francisco, which is intentional at this stage.

Culture signals that hold across every role here: high agency and self-direction, no settling for 90%, and attention to detail that matters concretely. In document parsing a comma versus a period turns $20,000 into 20.000, so sloppy work is a real red flag. Engineers are expected to hold technical conversations with enterprise customers, not just stay in the code.

The role: ML Infrastructure Engineer

We are looking for an ML Infrastructure Engineer with 3+ years of experience to own and scale the training and inference stack at a fast-growing AI document processing platform. You'll be a strong generalist who understands the mechanics of how ML models work – from serving and monitoring to building robust data pipelines – and can improve inference performance, reliability, and cost efficiency. This is a high-impact IC role where you'll work closely with ML researchers to ensure models are deployed quickly and reliably, and that infrastructure is never a bottleneck for the products being served. The ideal candidate is AI-native from the get-go, comfortable with 1-to-3 node training and single-to-double node serving, and thrives in a fast-paced startup environment.

What you will be doing

  • Building and maintaining model serving infrastructure – improving inference speed, monitoring, and reliability to ensure it's never a bottleneck for customers
  • Setting up and improving training infrastructure for models ranging from 300M to 30B parameters across 1-to-3 node environments
  • Developing observability, logging, and monitoring systems across the ML stack
  • Building internal data pipelines and tooling to help ML researchers move faster from experiment to production
  • Architecting infrastructure to arbitrate inference between multiple cloud providers while optimizing for accuracy, latency, and cost
Apply for this job
Powered by