For the sub-second compiled languages, it's basically a benchmark of startup times, not performance in the hot loop.
https://benchmarksgame-team.pages.debian.net/benchmarksgame/...
reply
1 billion iterations: - Startup + file read: 0.01ms - Computation: ~200ms - Overhead: 0.01%
The benchmark is definitely measuring the hot loop, not startup time.
For the sub-second compiled languages, it's basically a benchmark of startup times, not performance in the hot loop.