home/dictionary/Benchmark

Benchmark

nouncandidate·updated May 9, 2026

A standard, or point of reference, against which things may be compared or assessed.

Framework senses

Federal Financial Institutions Examination Council (FFIEC) IT Examination Handbook Infobase, Glossary1 senseview framework →
§1
A standard, or point of reference, against which things may be compared or assessed.
Comptroller's Handbook: Model Risk Management, Version 1.01 senseview framework →
§1
An alternative prediction or approach used to compare a model’s inputs and outputs to estimates from alternative internal or external data or models.
Systems and software engineering —Vocabulary1 senseview framework →
§1
Standard against which results can be measured or assessed; Procedure, problem, or test that can be used to compare systems or components to each other or to a standard.
PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparison.1 senseview framework →
§1
The term benchmarking is used in machine learning (ML) to refer to the evaluation and comparison of ML methods regarding their ability to learn patterns in ‘benchmark’ datasets that have been applied as ‘standards’. Benchmarking could be thought of simply as a sanity check to confirm that a new method successfully runs as expected and can reliably find simple patterns that existing methods are known to identify.