Questions tagged [caliper]

Caliper is Google's open-source framework for writing, running and viewing the results of Java microbenchmarks.

See the Caliper project site, and online result viewer.

The simplest complete Caliper benchmark looks like this:

public class MyBenchmark extends SimpleBenchmark {
  public void timeMyOperation(int reps) {
    for (int i = 0; i < reps; i++) {
      MyClass.myOperation();
    }
  }
}

Very short tutorial examples.

More introductory examples.

83 questions
2
votes
0 answers

How to prevent GC when using Caliper

When using caliper, I get the ERROR: GC occurred during timing. as some garbage gets produced in my benchmark, which I can't avoid. I guess, giving more memory to the target JVM could help, as there's not that much garbage. I'm aware about the -D…
maaartinus
  • 44,714
  • 32
  • 161
  • 320
2
votes
2 answers

How to use Caliper benchmark beta snapshot without maven?

I have been asked to use Google's Caliper project to create a few microbenchmarks. I would very much like to use the annotation features of the newest beta snapshot, but aside from a few small examples I am having trouble finding good documentation…
2
votes
1 answer

Robust json parser in Python or Java

I'm looking for a robust json parser in either Python or Java (so far, I've been working with Python, but as I'm using it to analyze a Java benchmark, using Java is a reasonable alternative.) Robust with respect to truncated and incomplete…
Erich Schubert
  • 8,575
  • 2
  • 26
  • 42
2
votes
0 answers

How to control reps with normal mode in caliper

I am able to control reps when i run benchmark in debug mode. sh ~/projects/poc/caliper/scripts/caliper --debug-reps 1 com.parquet.benchmark.BenchmarkParquetDirectWrites However when i run in regular mode sh ~/projects/poc/caliper/scripts/caliper…
deepujain
  • 657
  • 1
  • 10
  • 17
2
votes
1 answer

How to control the exact number of tests to run with caliper

I tried to understand, what is the proper way to control the number of runs: is it the trial or rep? It is confusing: I run the benchmark with --trial 1 and recieve the output: 0% Scenario{vm=java, trial=0, benchmark=SendPublisher} 1002183670.00 ns;…
ash1
  • 27
  • 3
1
vote
0 answers

Caliper loses track of worker with "Error: Could not find or load main class"

I'm trying to run Caliper, but I got the dreaded benchmark death exception: java.lang.RuntimeException: Got no response! at com.google.caliper.runner.CaliperRun.measure(CaliperRun.java:241) at…
Robert Fischer
  • 1,436
  • 12
  • 26
1
vote
2 answers

Caliper: ConfigurationException if I run with measureMemory parameter

I am getting ConfigurationException(agent library failed) when I turn on measureMemory parameter in Tutorial.java from Caliper source (http://code.google.com/p/caliper/source/browse/#svn%2Ftrunk%2Ftutorial) Not sure what I am missing. I have built…
ndchandar
  • 41
  • 3
1
vote
0 answers

How to fix this error encountered in generating a benchmark in Hyperledger Caliper? node:events:491 throw er; // Unhandled 'error' event ^

enter image description here I followed everything on this documentation https://hyperledger.github.io/caliper/v0.3.2/benchmark-generator/ but error "node:events:491 throw er;" is showing. node:events:491 throw er; // Unhandled 'error' event …
Lady
  • 11
  • 1
1
vote
2 answers

How can I integrate caliper benchmark tool with my hyperledger fabric network?

I have developed a system using Hyperledger Fabric peer version 2.2.2 hence I need to test the performance (i.e. latency, throughput etc.) of this system using Hyperledger Caliper. I'm new with Blockchain and found it hard to integrate my network…
Mahafuja
  • 13
  • 2
1
vote
1 answer

Hyperledger Fabric/Hyperledger Caliper Benchmarking

Been learning a bit about both Hyperledger Fabric and Hyperledger Caliper recently. Recently have been following the Hyperledger Caliper Fabric benchmarking tutorial here to learn a bit more about it. It uses the Fabric Samples network as an example…
1
vote
0 answers

Why containerized version of HL Caliper is always trying to connect to localhost?

When I try to run a containerized version of Caliper I always get an error message stating that the attempt to connect to the orderer failed unlike happens if I try to run a non containerized version of Caliper in the host machine where Hyperledger…
1
vote
0 answers

Error when running a test with hyperledger caliper

I have been trying for days to run a test with 3 Organizations that having 3 peers each. The tutorial that i am trying to make it work: https://github.com/haojun/caliper This is my first time, working with hyperledger. Docker: 19.03.8 Node:…
1
vote
0 answers

Timeout a Caliper benchmark

Is there a way to timeout a caliper benchmark test without an exception? I'd like to simply move on to the next test in the benchmark; skip current test without killing the rest of the tests. I haven't found any documentation of a clear way to do…
JPC
  • 1,891
  • 13
  • 29
1
vote
0 answers

Building Google Caliper

I'm trying to build google caliper on mac osx (10.9.5), using the latest git commit, and am running into the following issue: /ExperimentingCaliperRun.java:[225,18] cannot find symbol [ERROR] symbol: method…
JPC
  • 1,891
  • 13
  • 29
1
vote
1 answer

Running caliper commandline

OK, again having some problems with caliper. I am now running on Linux, trying to use the beta snapshot. I am attempting to run Google's caliper via commandline using just the jar. (Beta snapshot) I do not have access to maven on this machine, and…