The Infrastructure Challenge Behind Production AI

Today, I moderated a roundtable on the infrastructure behind production AI.

Today I had the pleasure of moderating a live roundtable with four practitioners on what it really takes to run AI in production. The hard part is no longer building the models; it’s keeping them running reliably at scale, with data systems, cloud platforms, and databases all under pressure.

We talked about what’s working, what’s breaking, and what engineering leaders need to rethink as AI becomes a permanent part of how we build software. Thanks to the panelists for such honest, practical perspectives.