Priya Raman

Principal Engineer, Northwind Labs

Priya builds inference infrastructure and has spent the last four years making large models cheap enough to run in production. She writes about batching, quantisation and the parts of MLOps nobody puts on a slide.

Session

AI Engineering Keynote

Serving 70B models on a budget

Wed 12 May, 09:30 – 10:15·Main Stage