Cosbench对象存储的测试

Cosbench下载地址:
https://github.com/intel-cloud/cosbench/releases/download/v0.4.0.1/0.4.0.1.zip

Read并发大的情况会存在读异常直接退出,需要关闭MD5校验:

  • stop-all.sh 停止 cosbench 进程(controller, drivers)
  • 编辑 cosbench-start.sh 文件,找到java启动命令行参数, 增加"-Dcom.amazonaws.services.s3.disableGetObjectMD5Validation=true" 关闭S3的MD5校验功能
  • start-all.sh 启动所有的cosbench processes.

进入目录,上传一个任务:
./cli.sh submit ../conf/bjf/cosbench.conf

界面:
http://{ip}:19088/controller

配置用例如下:
workflow下定义多个workstage,workstage之间是串行运行,workstage下的work并行运行。workers指定了并发数。

<?xml version="1.0" encoding="UTF-8" ?>  
<workload name="cosbench 64 driveer" description="64 drivers 10w ops">  

  <storage type="s3" config="accesskey={access-key};secretkey={secret-key};endpoint=http://{endpoint}" />  
  
  <workflow>  
    
    <workstage name="init">  
      <work type="init" workers="1" config="cprefix=cosbench;containers=r(1,1)" />  
    </workstage>  
  
    <workstage name="write">  
      <work name="write" workers="64" totalOps="100000">  
        <operation type="write" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000);sizes=c(1)MB" />  
      </work>  
    </workstage>  
      
    <workstage name="read">  
      <work name="read" workers="64" totalOps="100000">  
        <operation type="read" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000)" />  
      </work>  
    </workstage>    
  
    <workstage name="cleanup">  
      <work type="cleanup" workers="64" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000)" />  
    </workstage>  
      
    <workstage name="dispose">  
      <work type="dispose" workers="1" config="cprefix=cosbench;containers=r(1,1)" />  
    </workstage>  
      
  </workflow>  
  
</workload>
最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

推荐阅读更多精彩内容