Test summary
Prompt
48 Tools Run v15
Dataset
mcp-toolcall-acc
Status
15 Completed
Test run duration
13 minutes 40 seconds
Evaluation cost
-
Started At.
Jun 4, 2025, 10:08:00 AM
Author
M
Madhu Shantan
Summary by evaluator
Tool Call Accuracy
Result
Mean score
Pass rate
Fail
0.67
66.67%
Tokens
Type
Value
Total tokens
1173313
Input tokens
1157461
Completion tokens
15852
Cost
Type
Value
Total cost
$ 3.710163000000001
Input token cost
$ 3.472383
Completion token cost
$ 0.23778
Latency (ms)
Type
Value
min
6650.00 ms
max
53884.71 ms
p50
24367.00 ms
p90
51103.00 ms
p95
53887.00 ms
p99
53887.00 ms
mean
27064.80 ms
stdDeviation
15148.2078
total
15