11

I have developed a cloud storage system that uses the same API structure as Amazon S3. Now I want to run some performance tests on getting object data and object metadata. In such a way that I can compare my system with Amazon S3, OpenStack storage and other systems.

I have looked at some common file system benchmark tools, there is too much work to convert them for Cloud Storage systems.

I am looking for some benchmark tools similar to SIEGE, that not only can performance http requests, but also have some workload simulation features. For example, one simulation can be storing an entire static HTML website in the Cloud Storage then performance some workload stress test etc.

Can someone help and suggest some existing framework or tools that can be relatively easy to be fit for such cloud storage system benchmark scenario?

leon
  • 10,085
  • 19
  • 60
  • 77
  • Note that S3 is a dynamic system, so doing a 'quick benchmark' will give you terrible numbers. Here is an article about a similar test run on ELB: http://www.rightscale.com/blog/cloud-management-best-practices/benchmarking-load-balancers-cloud – BraveNewCurrency Jun 08 '14 at 04:30

2 Answers2

6

You can probably look into COSBench, which is a tool to benchmark object storage cloud services.

Vincenzo Pii
  • 18,961
  • 8
  • 39
  • 49
1

COSBench was a good solution but is getting old. The last effective commit is in 2017.

I'd suggest:

The 2nd one is mainly made by myself. It's on ongoing development and aims to test more than just S3 Object storages. The test suite contains:

  • Upload
  • Download
  • Multi Upload
  • Video streaming simulation
  • Ping/TCPping/Traceroute/TCPTraceroute
  • cURL details
Zulu
  • 8,765
  • 9
  • 49
  • 56