· Prakash Natarajan · Reliability
G-Eval for AI Agents: What the Score Doesn't Catch
G-Eval scores how good a reply sounds using an LLM judge and a chain-of-thought rubric. For an agent that plans and calls tools, that's only half the job.
Tag: ai agent evaluation
· Prakash Natarajan · ReliabilityAI Agent Benchmarks vs. Production Reliability
AI agent benchmarks like AgentBench and tau-bench tell you what a model can do in a lab. They don't tell you if your agent is actually working for your paying customers. Here's the gap and how to close it.
· Prakash Natarajan · ReliabilityAI Agent Hallucination: The Claim With No Action
AI agent hallucination is not always a wrong fact. Often it's a confident claim that no tool call ever backed up, and it skews the deflection rate you report to customers.
· Prakash Natarajan · ReliabilityAI Agent Testing: What to Check Before Customers Do
AI agent testing catches tool failures and bad outputs before they land in the deflection and cost numbers you report to customers. Here is what to test first, with real failure examples.