A conversation with Alex Rodriguez, ML Infrastructure Lead, about the realities of running AI systems in production, covering model serving, inference optimization, cost management, and operational challenges.
A detailed case study of our infrastructure cost optimization journey, covering rightsizing, architectural changes, and operational improvements that cut our monthly cloud spend from $150K to $60K.