How Do You Evaluate an Agent That Calls Tools That Call Other Tools?
Part 1, Your AI Agent Doesn't Need to See Every Tool, argued for hiding low-level tools behind domain functions like investigate_delivery_issue() that hide the API calls underneath. Part 2, Not Every Step Needs an LLM, went inside those functions and separated work that belongs in code from work that needs a model.
Now you have to find out whether any of it works.
Most teams start with the final reply. It is easy to read, easy to score, and often the least useful place to look when something breaks.
A convincing answer is not the same as a correct one
Take the request from Part 1:
"My order has not arrived. What can you do?"
This is the delivery example from Part 1, not the incident-diagnosis one from Part 2. Same failure modes either way. Delivery is just easier to follow end to end. The agent calls investigate_delivery_issue(customer_id,...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE
