As a yardstick of performance we are using the `best' performance as measured by the LINPACK Benchmark [7]. LINPACK was chosen because it is widely used and performance numbers are available for almost all relevant systems.
The LINPACK Benchmark was introduced by Jack Dongarra.
A detailed description as well as a list of performance results on a wide variety of machines is available in postscript form from netlib.
To retrieve a copy send electronic mail to netlib@ornl.gov and by typing the message send performance from benchmark
or from any machine on the internet type:
rcp anon@netlib2.cs.utk.edu:benchmark/performance performance.
The benchmark used in the LINPACK Benchmark is to solve a dense system of linear equations. For the TOP500 list, we used that version of the benchmark that allows the user to scale the size of the problem and to optimize the software in order to achieve the best performance for a given machine. This performance does not reflect the overall performance of a given system, as no single number ever can. It does, however, reflect the performance of a dedicated system for solving a dense system of linear equations. Since the problem is very regular, the performance achieved is quite high, and the performance numbers give a good correction of peak performance.
By measuring the actual performance for different problem sizes [tex2html_wrap3842], a user can get not only the maximal achieved performance [tex2html_wrap3844] for the problem size [tex2html_wrap3846] but also the problem size [tex2html_wrap3848] where half of the performance [tex2html_wrap3850] is achieved. These numbers together with the theoretical peak performance [tex2html_wrap3852] are the numbers given in the TOP500 list. If in the future a more realistic metric finds widespread usage, so that numbers for all systems in question are available, we may convert to that performance measure.