SPEC explains SPECjbb 2013 benchmark scores invalid due to bug




The Standard Performance Evaluation Corporation, or SPEC, has detected an error in its SPECjbb 2013 benchmark software. The error may result in a too high SPECjbb-score. The scores of the benchmark suite are therefore invalidated by SPEC.

The SPECjbb 2013 benchmark software is in use for testing servers. Therefore, the performance of Java code to be measured. The software has been since January last year on the market, but developer SPEC however reports that it has found a disturbing error in the benchmark software. The bug in the so-called partial Purchase Request -testonderdeel can result in a too high score, thus making a fair comparison is not possible.

SPEC has after the discovery of the bug decided to no longer sell SPECjbb 2013. Also uploading benchmark scores is no longer possible and existing scores are considered as unreliable. SPEC says working on a bug fix. Licensees of SPECjbb 2013 suite will in time get a free update.


In: Technology & Gadgets Asked By: [15446 Red Star Level]

Answer this Question

You must be Logged In to post an Answer.

Not a member yet? Sign Up Now »