0

I've recently discovered the Caliper benchmark framework for Java which seems like a very useful tool for microbenchmarks. I'm using it to run microbenchmarks for my vector maths library (vectorz)

However the standard "SimpleBenchmark" output gives a linear runtime chart which is not very useful if you have very different execution times:

        benchmark     ns linear runtime
  Vector3Addition   1.04 =
  Matrix3Rotation   4.92 =
VectorAddMultiple   6.29 =
    MatrixInverse 955.27 ==============================

How do you configure Caliper to output logarithmic runtime in the chart?

I'm running Caliper via code rather than from the command line: source code here

mikera
  • 105,238
  • 25
  • 256
  • 415

1 Answers1

1

Caliper dropped support for logarithmic result display quite early in development. You can still get it in the web app by clicking linear runtime to toggle.

Jesse Wilson
  • 39,078
  • 8
  • 121
  • 128
  • Thanks for letting me know! Seems like an odd thing to drop, it is quite useful.... – mikera Oct 11 '12 at 06:55
  • 2
    I was the big cheerleader for logarithmic results. We found it to be a lot less useful than we'd thought. And in the web app, most of the value comes from being able to move values that are incomparable to different columns (each column gets its own independent scale). BTW, in your case, it vaguely seems like you're lumping 4 very different benchmarks into the same class just for the convenience of running them at once, so I think it's a little unnatural. – Kevin Bourrillion Oct 11 '12 at 14:14