Questions tagged [caliper]

Caliper is Google's open-source framework for writing, running and viewing the results of Java microbenchmarks.

See the Caliper project site, and online result viewer.

The simplest complete Caliper benchmark looks like this:

public class MyBenchmark extends SimpleBenchmark {
  public void timeMyOperation(int reps) {
    for (int i = 0; i < reps; i++) {
      MyClass.myOperation();
    }
  }
}

Very short tutorial examples.

More introductory examples.

83 questions
0
votes
1 answer

Exception while running benchmark

I was just trying to write the simple benchmark - public class IntegerCompareBenchmark extends SimpleBenchmark { private Integer left; private Integer right; @Override protected void setUp() { left = 100; …
Premraj
  • 7,802
  • 8
  • 45
  • 66
0
votes
1 answer

Caliper Error: Transaction returned with failure. The key already exists

I'm still on my journey to set up the Caliper for the first time. Hope you can save me :) Right know I got the error: Transaction returned with failure: User 1 already exists. when I try to launch the caliper benchmark. Because I do not allow to…
0
votes
1 answer

Binding instances during Caliper benchmarks

I've recently been tasked with benchmarking some features of our API, and I've been using Caliper to do so. It seems fairly straightforward and is actually quite powerful, I've been following the tutorials here: How to use caliper Tutorial from the…
Phreakradio
  • 176
  • 1
  • 18
0
votes
1 answer

Why send rate is lower than configured rate in config.yaml (hyperledger caliper) even after use of only one client?

I configured send rate at 500 tps and I am using only one client so send rate should be around 500tps but in generated report send rate is around 130-40 tps. Why there is so much deviation? I am using fabric ccp version of caliper. I expect the send…
0
votes
1 answer

Error Failed to connect before the deadline running Hyperledger Caliper

When I run Hyperledger Caliper with Zookeper I get the following error: I got this error in the client(different machine), obviously the address is not localhost, the address is the server ip. When I go to logs, I can not see anything else... Only…
0
votes
0 answers

Error when running hyperledger caliper on hyperledger composer

i have been trying for days to get this working. My problem is that i have a running network with 4 peers (3 peers and 1 orderer) on 4 virtual machines, the network is able to communicate and everything seems to work, my issue is that hyperledger…
0
votes
0 answers

Google caliper -XX:CICompilerCount=2 vmOption does not apply

It's a known bug that since one of the build from Java 8 Tiered Compiler is turned on by default. And running benchmark without @VmOptions({"-XX:-TieredCompilation"}) will cause below error: [stderr] CICompilerCount of 1 is invalid; must be at…
Yeming Huang
  • 518
  • 1
  • 4
  • 11
0
votes
1 answer

Using Caliper 0.5 with instrumented code/JRE

Disclosure: I'm not super familiar with Java, so if anything rings untrue below, please point out I'm trying to run some microbenchmarks with Caliper for instrumented code, with an instrumented JRE. I set my JAVA_HOME to point to the instrumented…
JPC
  • 1,891
  • 13
  • 29
0
votes
1 answer

Caliper error Use microbenchmark instrument

I don't seem to be able to get started here. I pulled down the code and built caliper myself, which solved my first set of problems, but now I am getting errors that I need a microinstrument This experiment requires a microbenchmark. The…
0
votes
1 answer

Specify additional dimensions for benchmarks to Google Caliper

I am using Google Caliper (latest master code) to benchmark four pieces of code across two dimensions. For example, the following benchmark methods: @Benchmark mechanismOneBreadth(...) @Benchmark mechanismOneDepth(...) @Benchmark…
Raman
  • 17,606
  • 5
  • 95
  • 112
0
votes
1 answer

java not finding class in jar after successfully compiling with javac against same jar

I was looking at this question on stackoverflow and thought I'd try to run the benchmark myself. I downloaded caliper and compiled it successfully using maven. I then compiled HashCodeBenchmark from the linked question successfully using the jar…
Dunes
  • 37,291
  • 7
  • 81
  • 97
0
votes
1 answer

Caliper test using exec-maven-plugin is saying main method signature isn't valid

I'm trying to get Caliper working with maven, I haven't successfully ran a caliper benchmark test as of yet. Caliper version: 1.0-beta-1 My benchmark: public class MyXercesSAXHandlerBenchmark extends Benchmark{ @Param({"10", "100", "1000",…
Blankman
  • 259,732
  • 324
  • 769
  • 1,199
0
votes
1 answer

Google Caliper: can't complete benchmark (The worker exited without producing data)

When I try to run a benchmark method with Caliper, it exits before completing any measurements. I confirmed in debugger that Caliper is executing the benchmark method twice, when it is going through its dry run phase. But when it tries to run the…
Sam Goldberg
  • 6,711
  • 8
  • 52
  • 85
0
votes
0 answers

Multiple 500 errors when google caliper tries to upload benchmark results to microbenchmarks.appspot.com

I'm seeing multiple HTTP 500 errors when Caliper tries to upload the JSON result files for the benchmarks I'm running. The logs are filled with exceptions similar to the one below: Dec 19, 2013 3:29:20 PM com.google.caliper.runner.ResultsUploader…
kodeninja
  • 339
  • 1
  • 7
  • 23
0
votes
1 answer

405 when posting Caliper results online

I checked out the latest version of caliper and ran a few benchmarks. The result are generated (as json) just fine, but upload to the microbenchmarks appengine website fails with: POST http://microbenchmarks.appspot.com .... returned a response…
Eleco
  • 3,194
  • 9
  • 31
  • 40