Questions tagged [caliper]

Caliper is Google's open-source framework for writing, running and viewing the results of Java microbenchmarks.

See the Caliper project site, and online result viewer.

The simplest complete Caliper benchmark looks like this:

public class MyBenchmark extends SimpleBenchmark {
  public void timeMyOperation(int reps) {
    for (int i = 0; i < reps; i++) {
      MyClass.myOperation();
    }
  }
}

Very short tutorial examples.

More introductory examples.

83 questions
1
vote
1 answer

non-deterministic allocation behavior in caliper benchmark

I am trying to benchmark the performance of two different log4j Pattern layouts when used via slf4j. I am using caliper (current HEAD version). Here's my benchmark class: public class PatternLayoutBenchmark { // fully qualified names wherever…
Sean Patrick Floyd
  • 292,901
  • 67
  • 465
  • 588
1
vote
1 answer

How to install certificate in Java1.6 so that upload from Caliper tool works

I am using Caliper to run some benchmarks and upload results to https://microbenchmarks.appspot.com/ However, the upload fails due to certificate problems with SSL (see stack trace at bottom). How do I solve this problem? OS: Mac OS X Mavericks…
Andrew Mackenzie
  • 5,477
  • 5
  • 48
  • 70
1
vote
1 answer

Is it possible to run caliper using IntelliJ 'run' command inside of main?

I am new to caliper, and I want to know if it is possible for me to create a main method and then right-click and select 'run' using with IntelliJ? public class Benchmark1 extends Benchmark{ @Param({"10", "100", "1000", "10000"}) private int…
Blankman
  • 259,732
  • 324
  • 769
  • 1,199
1
vote
0 answers

Unable to load caliper results online

I followed few suggestions available online but none has helped. Got caliper and built it from https://github.com/peterlynch/caliper export…
deepujain
  • 657
  • 1
  • 10
  • 17
1
vote
1 answer

guava-11.0.1.jar and Maven plugin for eclipse

I created maven project in Eclipse and added a few dependencies. Here is a full list of dependencies: javax.servlet servlet-api
user341203
  • 29
  • 1
  • 7
1
vote
2 answers

Is Caliper 1.0 still on track?

In various other caliper posts, it would seem that Caliper was approaching a 1.0 release sometime in October (i.e,. in August the answers were along the line "wait two months"), but there hasn't been any activity in the git repo since June 18th. …
BeeOnRope
  • 60,350
  • 16
  • 207
  • 386
1
vote
1 answer

Force fixed column order with caliper

I'm running a caliper benchmark with multiple time* methods and two parameters and at the end get a nice table like parameter1 parameter2 benchmark After a small change to a method body I get another nice table like parameter2 benchmark…
maaartinus
  • 44,714
  • 32
  • 161
  • 320
1
vote
1 answer

Micro-benchmarking for regular expression using Caliper

I use Google Caliper to benchmark two methods which check the mdn number in a string. One method uses the user-defined method whereas other uses the regular expression. I am really surprised to find that on average, the regular expression method…
Rakesh
  • 3,987
  • 10
  • 43
  • 68
1
vote
2 answers

Caliper: why not use an annotation to define a benchmark?

Just found out about Caliper, and going through the documentation - it looks like a great tool (thanks Kevin and the gang at Google for opensourcing it). Question. Why isn't there an annotation-based mechanism to define benchmarks for the common use…
Francesco Callari
  • 11,300
  • 2
  • 25
  • 40
0
votes
2 answers

Using Caliper to benchmark REST Services ... or not?

I want to compare the response time between different services I made. I heard about Caliper so I decided to use it in a very simple way to make calls and measure them, with some functions like that: public void timeCallingService(int reps) { …
Simon Urli
  • 449
  • 1
  • 5
  • 12
0
votes
1 answer

Error while executing Hyperledger Caliper benchmark on Ubuntu 16.04 and Linux Mint 21

I'm trying to execute a benchmark using Hyperledger Caliper on Ubuntu 16.04 and also on Linux Mint 21. I have installed Node.js and npm, and am running the command: npx caliper launch manager \ --caliper-workspace . \ --caliper-benchconfig…
0
votes
1 answer

hyperledger caliper with multi-host deployment using docker-swarm

i have trouble in executing chaincode such as fabcar, smallbank, etc... i am working with two servers. First server has 1org(2peers), 2orderers, cli. second server has 1org(2peers), 1orderer. below is a crypto-config.yaml file # Copyright IBM Corp.…
0
votes
1 answer

Validation Error in running Hyperledger Caliper V0.4.2 with Fabric 2.1

When I have been running the Caliper V0.4.2 for measuring the benchmarks of Fabric 2.1.0 1.4.7, I got the below error ValidationError: child "version" fails because ["version" must be one of [1.0]]. child "clients" fails because ["clients" is…
Gowthami
  • 1
  • 2
0
votes
0 answers

Configuring Caliper to print metrics during a test round?

In hyperledger fabric benchmarking, Caliper prints report result after finishing test round. How can I configure Caliper to print or emit metrics such as TX delay, TX success rate, and resource statistics (cpu, ram, ...) during a test round for…
0
votes
1 answer

Caliper giving 0 for all allocation metrics

The following benchmarking code in Caliper import com.google.caliper.BeforeExperiment; import com.google.caliper.Benchmark; import com.google.caliper.Param; import com.google.caliper.runner.CaliperMain; public class Bench_IsInstrumentationWorking…
lineage
  • 792
  • 1
  • 8
  • 20