New: Intelligent Flashcards spaced-repetition decks for every topic, built to make things actually stick.
An agent runs against a 200-task evaluation set and resolves 150 of them according to the defined success criteria. What does the resulting 75% Task Success Rate tell you?
The probability that the same agent succeeds on every retry of a given task
The fraction of evaluation tasks the agent completed successfully under the defined criteria
The fraction of trials in which the agent took the most efficient reasoning path