Questions tagged [ycsb]

Yahoo! Cloud Serving Benchmark (YCSB): framework and common set of workloads for evaluating the performance of different "key-value" and "cloud" serving stores.

The goal of the Yahoo! Cloud Serving Benchmark (YCSB) project is to develop a framework and common set of workloads for evaluating the performance of different "key-value" and "cloud" serving stores.

The project comprises two areas:

  • The YCSB Client, an extensible workload generator;
  • The Core workloads, a set of workload scenarios to be executed by the generator;

Although the core workloads provide a well-rounded picture of a system's performance, the Client is extensible so that you can define new and different workloads to examine system aspects, or application scenarios, not adequately covered by the core workload. Similarly, the Client is extensible to support benchmarking different databases. Although we include sample code for benchmarking HBase and Cassandra, it is straightforward to write a new interface layer to benchmark your favorite database.

A common use of the tool is to benchmark multiple systems and compare them. For example, you can install multiple systems on the same hardware configuration, and run the same workloads against each system. Then you can plot the performance of each system (for example, as latency versus throughput curves) to see when one system does better than another.

You can find the source code and binaries to benchmark your hadoop environment from github. It is not perfect for newer versions of hadoop, so you can clone the repository, suggest improvements and commit your changes.

122 questions
0
votes
1 answer

How to enable concurrent users in YCSB for benchmarking

I am using YCSB for benchmarking MongoDB and I want to check its performance with multiple users. How do I simulate concurrent users? Are number of threads in the config file of YCSB denoting the concurrent users? Please help
user1439690
  • 659
  • 1
  • 11
  • 26
0
votes
1 answer

Exception while running the ycsb load command in cassandra

I loaded the latest cassandra package from datastax website. Also downloaded the ycsb files from github. I am running the Ubuntu in VMware and put these files in mounted folder from windows. Then i ran the cassandra, in background. Made the…
Shantanu
  • 121
  • 1
  • 1
  • 7
0
votes
1 answer

YCSB not able to load data into cassandra multinode

I am trying to load data using YCSB tool into cassandra multinode set up, using the below command. ./ycsb load cassandra-10 -P ../workloads/workloadb -s but I am getting the following output. I put the hosts parameter in workload as server's IP…
0
votes
1 answer

YCSB Error with scan operation on mysql db

I am trying to run a scan-only workload using YCSB client on MySQL database (a 10GB setup). I am using the following command to run the workload ./bin/ycsb run jdbc -P workloads/workloademod -p db.driver=com.mysql.jd …
0
votes
2 answers

MongoDB read preferences Secondary

I am just starting to use MongoDB while testing it with YCSB and I have a couple of questions about read preferences and its implementation. I have setup 1 Primary and 2 Secondary nodes, and set reading preferences on YCSB java client like this…
kirbo
  • 1,707
  • 5
  • 26
  • 32
0
votes
0 answers

when concurrent read and write to hbase, the write time doesn't change with the amount of data

I have seven machines acting as slaves, I used four of them to write to hbase and three of them to read from hbase. However, the four which I use to write to hbase always take constant time:247 minutes when writing 25 million,50 million, 80 million…
Demonedge
  • 1,363
  • 4
  • 18
  • 33
0
votes
2 answers

YCSB can't load data

I use YCSB-0.1.3 to test Hbase 0.96, there is one server and three slaves and I configure my YCSB reffered to this blog: http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/ However, when I tried to load workload, I get the…
Demonedge
  • 1,363
  • 4
  • 18
  • 33
0
votes
1 answer

How to Run YCSB for a redis Cluster on Ubuntu

I am new to YCSB and i want to benchmark Redis using more than one cluster. I have tried with only one Redis on my localhost with the following command. ./bin/ycsb load redis -p redis.host=localhost -p redis.port=6379 -P workloads/workloada -p…
isc
  • 526
  • 1
  • 5
  • 17
0
votes
1 answer

How to change consitency level in YCSB?

I need to change the write and read consistency level of Cassandra ONE to QUORUM in YCSB. Whether, I need to change inside a Java client program or to pass as command line parameter. Please give me some suggestion
0
votes
2 answers

MongoDB with same throughput

I'm testing mongodb starting with one node, then 2 datanodes (1 master, 1 config-server and 2 masters), then 4 datanodes (1 master, 1 config-server, 4 masters) and with 16 datanodes (same configuration as before with 16 masters). I noticed the…
user2867270
  • 161
  • 2
  • 8
0
votes
1 answer

YCSB understanding the output

I search in the site and found another question about that, but there's no answers. I'm executing YCSB tool on a cassandra cluster, and the output of YCSB is: [OVERALL], RunTime(ms), 302016.0 -> 05 mins 02 secs [OVERALL], Throughput(ops/sec),…
user2867270
  • 161
  • 2
  • 8
0
votes
1 answer

Cassandra load distribution - uneven 1.2.8

I am running a 4 node cluster setup of apache-cassandra-1.2.8 and trying to load about 25 million records. The cluster is setup with the default (murmur) partitioning and assigned tokens based on the algorithm provided here The nodetool displays the…
0
votes
1 answer

YCSB Execution Error

When i am running YCSB, i am getting the following error. I followed all the steps specified in YCSB git hub link, but still i am getting this error Exception in thread "Thread-3" java.lang.NoSuchMethodError:…
Rohit
  • 635
  • 6
  • 12
  • 22
0
votes
0 answers

Adding a class to a package from a dependency with maven

I'm trying to run YCSB on windows. There's a python script in the bin folder to run it. Here are the contents of the file. When I run it in cygwin on windows I get: $ ./bin/ycsb load basic -P workloads/workloada File "./bin/ycsb", line 51 print…
Will
  • 655
  • 6
  • 16
-1
votes
2 answers

How to create a table of 5 GB in HBase for YCSB benchmarking?

I want to benchmark an HBase using YCSB. It's my first time using either. I've gone through some online tutorials, and now I need to create a sample table of size 5 GB. But I don't know how to: Batch-put a bunch of data into a table Control the…
JrZ
  • 9
  • 2
1 2 3
8
9