NYC Tech Week · Building LLM-Powered Products
From Prototype to Production:
What Actually Changes
Building production AI workflow systems — what the architecture actually required.
Routing
State
Context
Caching
Feedback
Evals
Shilpi Nayak
Co-founder & CTO, GoodFin · 15+ yrs building large-scale AI at Google, Akamai, Intel
Production AI Workflow Layer
Live Conditions
RouteBefore answer
GroundBefore trust
LearnAfter failure