Benchmarks

Last updated 4 July 2007.

We have graphed the performance of several popular compilers on the Gambit benchmarks collected by Marc Feeley. Please keep in mind that the results of benchmarking should not be taken too seriously.

At this moment, we have timings only for the "R6RS" mode of benchmarking: safe compiled code with generic arithmetic, with immutable bindings for all standard procedures. We have run these benchmarks on two very different machines:

The benchmarked systems:

The numbers shown are for a single run on a machine with no other users. Most numbers give the elapsed time in seconds for a single run on a machine with no other users, but cpu time is shown for MIT Scheme. The bar graphs show relative performance. Longer is better.

When no timing is shown for a system, we probably weren't able to get that system to run that particular benchmark without changing the compiler options or the benchmark. In some cases, the problem may be caused by non-portable code in the benchmark.