Nishant Gupta

Deterministic Infra for Non-Deterministic AI Agents - Nishant Gupta, Meta Superintelligence Labs

Jun 29, 2026 · 7:14

Nishant Gupta, a Software Engineering Tech Lead at Meta Superintelligence Labs, argues that AI agents must be treated as distributed systems and that infrastructure, not prompts or models, will determine competitive advantage. He highlights the 'great mismatch' between deterministic cloud infrastructure and probabilistic, stateful, long-running agents, which leads to failures like recursive reasoning loops and retry amplification. Gupta advocates for a control plane that separates model proposals from production execution via policy engines and execution gateways, and emphasizes layered safety, multi-dimensional observability, and controlled recovery patterns adapted from distributed systems. He notes that memory consistency is a critical challenge, and that human oversight should remain as exception handling rather than being eliminated. The episode concludes that the future of AI will be won by better systems, not better prompts or models.

Production Evals For Agentic AI Systems - Nishant Gupta, Meta Superintelligence Labs

Jun 25, 2026 · 8:12

Nishant Gupta, a Software Engineering Tech Lead at Meta Superintelligence Labs, argues that evaluating agentic AI systems requires a shift from offline benchmarks to production infrastructure. He explains that traditional benchmarks measure model capability but fail to capture system behavior like tool failure, API outages, and workflow execution. Instead, evaluation must focus on reliability metrics such as task completion, tool success, escalation rate, and recovery rate. Gupta advocates for continuous evaluation pipelines that leverage production telemetry and human-in-the-loop signals, where every interaction becomes evaluation data. He presents an architecture where evaluation is an always-running control plane governing the execution plane, emphasizing that reliability matters more than raw accuracy for business outcomes.