Test summary
Prompt
25 Tools Run v10
Dataset
mcp-toolcall-acc
Status
15 Completed
Test run duration
10 minutes 20 seconds
Evaluation cost
-
Started At.
Jun 4, 2025, 6:14:03 AM
Author
M
Madhu Shantan
Summary by evaluator
Tool Call Accuracy
Result
Mean score
Pass rate
Fail
0.73
73.33%
Tokens
Type
Value
Total tokens
877522
Input tokens
862058
Completion tokens
15464
Cost
Type
Value
Total cost
$ 2.818134
Input token cost
$ 2.586174
Completion token cost
$ 0.2319600000000001
Latency (ms)
Type
Value
min
6212.00 ms
max
48851.60 ms
p50
21215.00 ms
p90
45791.00 ms
p95
48863.00 ms
p99
48863.00 ms
mean
22139.07 ms
stdDeviation
12229.253
total
15