Machine Learning Engineer, Ops

$125k - $165k

Workplace
Remote ok
Employment
Full-time

About this role

About Cantina:

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

About the Role:

We are looking for an ML Engineer to own the production inference stack for our text-to-speech (TTS) and speech recognition (ASR) models, end to end. Our research team delivers trained model checkpoints; you will productionize them as low-latency, real-time streaming services that run cost-efficiently on GPUs. The role covers the inference engines, the Kubernetes infrastructure they run on, and the performance benchmarking and accuracy validation that let us ship changes safely. You will bridge research and production, and own latency, throughput, cost and accuracy as we scale.

What You’ll Do:

  • Build and optimize streaming inference engines for TTS and ASR models, including multi-stage model pipelines.

  • Optimize latency (time to first chunk, p50/p99) and throughput using continuous batching, CUDA Graphs, torch.compile and mixed precision.

  • Maintain numerical parity with the reference implementation through automated accuracy regression tests, per stage and end to end.

  • Deploy and operate GPU inference services on Kubernetes: autoscaling, containerization and infrastructure as code.

  • Build CI/CD for model artifacts, with model versioning and reproducible releases.

  • Own observability and performance benchmarking: p50/p99 latency, real-time factor (RTF), GPU utilization and cost per request.

  • Partner with research to productionize new models.

What You’ll Bring:

  • Hands-on experience deploying, scaling and optimizing ML models in production, beyond consuming model APIs.

  • Working knowledge of the full inference stack, from CUDA kernels to serving frameworks, with depth in some layers; expertise across all of them is not expected.

  • GPU performance optimization: profiling (Nsight Systems, PyTorch Profiler), memory bandwidth, CPU-GPU synchronization.

  • Solid understanding of model serving: continuous batching, KV cache management, request scheduling.

  • Production experience with Kubernetes, CI/CD and cloud infrastructure.

  • Strong Python and PyTorch, and a rigorous approach to performance benchmarking.

  • Experience with speech or audio models (TTS, ASR, voice conversion).

  • Experience with inference frameworks such as vLLM (vLLM-Omni), SGLang, TensorRT-LLM, TensorRT or Triton Inference Server.

Compensation:

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles:

  • Competitive salary and generous company equity

  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina

  • 42 days of paid time off, including:

    • 15 PTO days

    • 10 sick days

    • 15 company holidays

    • 2 floating holidays

  • Generous parental leave & fertility support

  • 401(k) retirement savings plan

  • Lifestyle spending account – $500/month to use however you’d like

  • Complimentary lunch and snacks for in-office employees

  • One Medical membership, and more!

Apply to Cantina Consulting

Clera fills in Cantina Consulting's application for you.

How it works

Open the role in Clera

Sign in, and this role opens on your Clera job board, ready to apply.

Clera fills in the application

Clera fills the form from your profile and resume, and asks what's missing.

Track it in Clera

Each application you send shows up in your Clera tracker, sorted by stage.

Want Clera to find roles for you?

Ask your AI about this role

It knows you. Clera gives it the role.

Does this role fit my profile?

First time? Connect Clera once, about a minute.
One click above pre-fills the connector. Or by hand: Settings > Connectors > Add custom connector, paste https://mcp.getclera.com. Either way, sign in with the account you use on Clera and approve the consent screen.
https://mcp.getclera.com

Sign in with your Clera account. MCP docs

About Cantina Consulting

Cantina is an innovation consultancy headquartered in Boston. For more than 15 years, we’ve partnered with visionary business leaders to challenge the status quo, reimagine products & services for a customer-centric age, and drive new growth and efficiencies for our client’s organizations.

What we’ve learned throughout our history is that innovation is not magic. It’s the result of disciplined craft and methodology that bridges the gap between design thinking and design doing. By applying a creative, multidisciplinary approach, Cantina helps our clients create and sustain innovation, transform business-as-usual, and improve the lives of customers and employees.

Team size
51-200 employees people
Founded
2007
Industry
Design
Workplace
Remote ok
Locations
United States

Benefits

  • Competitive salary
  • Company equity
  • Medical insurance
  • Dental insurance
  • Vision insurance
  • 42 days of paid time off
  • Parental leave
  • Fertility support
  • 401(k) retirement savings plan
  • Lifestyle spending account
  • Complimentary lunch and snacks
  • One Medical membership