· Prakash Natarajan · Reliability
Prompt Versioning Without Breaking Deflection Rate
Prompt versioning tracks changes to an AI agent's prompt, but an eval score that passes on average can still hide a regression that only shows up in one tenant's deflection rate.