Questions tagged [ycsb]

Yahoo! Cloud Serving Benchmark (YCSB): framework and common set of workloads for evaluating the performance of different "key-value" and "cloud" serving stores.

The goal of the Yahoo! Cloud Serving Benchmark (YCSB) project is to develop a framework and common set of workloads for evaluating the performance of different "key-value" and "cloud" serving stores.

The project comprises two areas:

  • The YCSB Client, an extensible workload generator;
  • The Core workloads, a set of workload scenarios to be executed by the generator;

Although the core workloads provide a well-rounded picture of a system's performance, the Client is extensible so that you can define new and different workloads to examine system aspects, or application scenarios, not adequately covered by the core workload. Similarly, the Client is extensible to support benchmarking different databases. Although we include sample code for benchmarking HBase and Cassandra, it is straightforward to write a new interface layer to benchmark your favorite database.

A common use of the tool is to benchmark multiple systems and compare them. For example, you can install multiple systems on the same hardware configuration, and run the same workloads against each system. Then you can plot the performance of each system (for example, as latency versus throughput curves) to see when one system does better than another.

You can find the source code and binaries to benchmark your hadoop environment from github. It is not perfect for newer versions of hadoop, so you can clone the repository, suggest improvements and commit your changes.

122 questions
2
votes
1 answer

How to verify data is loaded into mongodb after load generation phase in ycsb?

I am trying to use ycsb to carry out benchmarking of mongodb. I have downloaded and installed mongo db as per instructions specified on YCSB MongoDB After that I created "ycsb" named database in mongodb using below commands 1. use ycsb 2.…
Nachiket Kate
  • 8,473
  • 2
  • 27
  • 45
2
votes
1 answer

YCSB error on Hbase

I am trying to get YCSB-0.1.4 to test Hbase 0.98.1 on CDH 5.1.2. I followed instructions here https://github.com/brianfrankcooper/YCSB/wiki/Getting-Started. When I run the YCSB test, it works but its not loading data into the usertable. Do not see…
nomad
  • 21
  • 3
2
votes
1 answer

Cassandra not balancing data over existing nodes in cluster

Greeings, I have configured 3 node Cassandra 1.2.12 cluster and I am able to connect to master and create keyspaces and tables over all nodes. However, I want to run YCSB over my cluster so when I run YCSB and load data it is all loaded on Master.…
Nika
  • 43
  • 4
2
votes
2 answers

running ycsb workloads on mongodb

I am running the YCSB tool on mongodb for benchmarking db and I notice that once I load a workload ( workloada for example) and run a transaction ( target 1500 for example) I am not able to run another transaction without dropping the entire…
1
vote
1 answer

Retrieving data from an abstract class

I am having difficulty accessing some data. I am using YCSB to talk to a number of different databases, such as Cassandra and MongoDB. The only class I can really modify is my "Workload" class, which is doing some insertions and reads. The method I…
eggonlegs
  • 1,824
  • 2
  • 23
  • 34
1
vote
0 answers

Perform YCSB benchmark on MongoDB atlas

I would like to measure the performance of MongoDb Atlas with the YCSB benchmark. For testing, I first performed the benchmark on ubuntu on a localhost mongo db instance, which works fine, so the benchmark seems to be set up correctly. Now I wanted…
ruebe99
  • 11
  • 1
1
vote
1 answer

YCSB differences between Workload F and workload A

I don't understand what the difference between workload A (50% read, 50% update) and workload F(50% read, 50% read-modify-write) update isn't read-modify-write ? what the difference between read operation and scan operation ? i don't understand…
1
vote
0 answers

YCSB get stuck when working with Cassandra

The command I use: sudo bin/ycsb run cassandra-cql -P workloads/workloadf -P cassandra.dat -s > outputs/runf-2.dat 2> outputs/log-runf-2.txt And: tail -f outputs/log-runf-2.txt But the log stuck at: 2021-08-16 17:36:38:255 7850 sec: 65373659…
RanZ
  • 31
  • 2
1
vote
0 answers

Unauthorized error when running ycsb on mongodb

I'm trying to run ycsb on my mongodb instance (runs in the cloud). On mongodb side I have create two users with a two very wide scope of permissions: > show users { "_id" : "admin.admin", "user" : "admin", "db" : "admin", "roles" :…
1
vote
1 answer

Observing READ-FAILED after 2.5 hrs when running YCSB on Cassandra

I am new to Cassandra and YCSB and trying to run benchmarking on the 3 node cassandra cluster which is built through docker-compose with YCSB. YCSB's load phase completed in 4 hrs without any error or issues but in the run phase, I am seeing…
learning
  • 17
  • 3
1
vote
0 answers

Write personnalized workload on YCSB

I would like to compare the performance of cassandra and mangodb systems and besides the standard ycsb workloads I would like to write my own queries such as nested queries. is this possible and if so how to proceed. thank you
1
vote
1 answer

How to exposing CockroachDB using Ingress on Google Cloud for external loadtesting

For my current distributed databases project in my studies I should deploy a CockrouchDB Cluster on Google Cloud Kubernetes Engine and run a YCSB Loadtest against it. The YCSB Client is going to run on another VM so that the results are comparable…
1
vote
1 answer

Testing scalability of Postgres Database

For my project built on Postgres, I want to check the system's scalability. Are there any standard database benchmarks suitable for it? I have gone through YCSB but could not get it to work with Postgres. TPC benchmarks do not really challenge…
Subhodeep Maji
  • 100
  • 1
  • 10
1
vote
2 answers

Bash Script - Python can't find a path

Please I need help! This is my first bash script, and it's calling a python script at some points. But I always get this output at line 28 and 40: ./startTests.sh: line 28: 'logs/tp1/load-test1-workloada.txt': No such file or directory The…
1
vote
1 answer

Mongodb write performance is confusing

I did a write performance test in MongoDB using YCSB and it is producing the confusing result, ./bin/ycsb load mongodb -s -P workloads/workloada -p recordcount=10000 -threads $tread_count -p…
Harry
  • 3,072
  • 6
  • 43
  • 100
1
2
3
8 9