Installation and Operation Guide for BigBench on MaxCompute Benchmarking Suite

Prerequisites
1、Create An Alibaba Cloud account.
2、The MaxCompute user-end software (preferably 0.27.0 or later) has been installed and configured. For details, see installation and configuration.
3、Java 1.7 (Oracle/OpenJDK) or later has been installed (preferably the 64-bit version).

Download the BigBench suite
1、Click this link to download the BigBench on MaxCompute suite.
2、You can also obtain the BigBench on MaxCompute suite from the GitHub address of the following project.

Configure BigBench on MaxCompute
1、Edit engineSettings.conf in the engines/maxcompute/conf folder and configure the MaxCompute client to run the file as follows.

BINARY="$MAXCOMPUTE_CLIENT_DIR/bin/odpscmd"

2、Edit userSettings.conf in the conf folder and configure the project name of MaxCompute as follows.

export BIG_BENCH_DEFAULT_DATABASE="$MAXCOMPUTE_PROJECT_NAME"

3、Edit bigBench.properties in the conf folder and configure the test phase of BigBench as follows.

workload=BENCHMARK_START,POWER_TEST,THROUGHPUT_TEST_1,BENCHMARK_STOP,VALIDATE_POWER_TEST,VALIDATE_THROUGHPUT_TEST_1

Use the preceding default test phase unless otherwise specified.

Run the BigBench on MaxCompute benchmarking suite.**
Use the BigBench driver script to run BigBench benchmarking.

$INSTALL_DIR/bin/bigBench runBenchmark

BigBench on MaxCompute log directory
The running log and result log are stored in the following directory:

$INSTALL_DIR/logs

FAQ

How to set MaxCompute parameters in the BigBench benchmarking suite?
Set parameters for all MaxCompute queries in the engineSettings.sql file. The file is located at the following path:

$INSTALL_DIR/engines/maxcompute/conf/engineSettings.sql

The file contains a series of MaxCompute parameters. Use the default setting unless otherwise required.

How to set MaxCompute parameters for a specific query?
Set parameters in the engineLocalSettings.sql file in the queries directory. The file is located at the following path:

$INSTALL_DIR/engines/maxcompute/queries/q??/engineLocalSettings.sql

You can set MaxCompute parameters for a specific query in the preceding file. The BigBench suite automatically imports the file and overwrites the global variables of MaxCompute. Use the default setting unless otherwise required.

时间: 2024-11-05 06:25:28

Installation and Operation Guide for BigBench on MaxCompute Benchmarking Suite的相关文章

BigBench on MaxCompute 基准测试套件简明安装与运行指南

先决条件 注册阿里云账户 MaxCompute客户端软件 (推荐使用0.27.0或以上版本) ,详情请见:安装并配置客户端 Java 1.7 (Oracle/OpenJDK) 或以上版本 (推荐使用64位版本) . 下载BigBench 套件 请点击此链接,下载BigBench on MaxCompute套件. 或直接访问以下该项目的github地址以获取BigBench on MaxCompute 套件. 配置BigBench on MaxCompute 编辑engines/maxcomput

MaxCompute 2.0 基于BigBench标准的最新测试进展

10月14日,2017杭州云栖大会·阿里云大数据计算服务(MaxCompute)专场,阿里云技术专家路璐带来<MaxCompute基于BigBench标准的最新测试进展>分享.   在11日的主论坛上,MaxCompute做了敢为人先.引领潮流BigBench On MaxCompute2.0的重磅发布,意味着MaxCompute成为第一个做到100TB数据规模的BigBench,并且在100T数据规模的Qpm达到7830Qpm,成为第一个达到7000分的大数据引擎.同时MaxCompute也

Breakthrough in Alibaba Cloud Computing Capabilities - BigBench Reaches 100 TB World Record

In the first day of the 2017 Hangzhou Computing Conference on Oct. 11, Alibaba Cloud President Hu Xiaoming introduced a next-generation computing platform MaxCompute + PAI. In the main forum on the 12th, Zhou Jingren, Alibaba Group Vice President and

阿里巴巴大数据计算平台MaxCompute(原名ODPS)全套攻略(持续更新20171122)

  概况介绍 大数据计算服务(MaxCompute,原名ODPS,产品地址:https://www.aliyun.com/product/odps)是一种快速.完全托管的TB/PB级数据仓库解决方案.MaxCompute向用户提供了完善的数据导入方案以及多种经典的分布式计算模型,能够更快速的解决用户海量数据计算问题,有效降低企业成本,并保障数据安全.本文收录了大量的MaxCompute产品介绍.技术介绍,帮助您快速了解MaxCompute/ODPS. MaxCompute 2.0:阿里巴巴的大数

Alibaba Cloud releases MaxCompute big data platform in the U.S.

On November 16, 2017, Alibaba Group's cloud computing platform, Alibaba Cloud, officially launched its MaxCompute big data platform in the United States. This platform was independently developed by Alibaba Cloud and possesses many features, includin

阿里云计算能力实现新突破 BigBench全球首次达到100TB

在10月11日开幕的"2017杭州·云栖大会"首日主论坛,阿里云总裁胡晓明重点介绍新一代计算平台MaxCompute+PAI. 在12日的主论坛中,阿里巴巴集团副总裁,搜索事业部&计算平台事业部负责人周靖人说,数据是机器智能创新的基础,拥有充沛的计算能力才能全面释放数据的价值.随后周靖人与英特尔公司数据中心事业部副总裁Rob Hays共同进行BigBench On MaxCompute[1] 2.0+PAI的重磅发布.本次发布突破了TPCx-BB[2] 公布的各项历史最佳成绩,

阿里云计算能力实现多项突破 BigBench规模全球首次被拓展至100TB

10月12日,阿里巴巴集团副总裁周靖人在云栖大会上发布了阿里云在大数据计算能力上的新突破:将BigBench数据规模扩展到100T. 周靖人说,数据是机器智能创新的基础,拥有充沛的计算能力才能全面释放数据的价值.我们希望通过不断的释放阿里云的计算红利,帮助开发者抓住更多市场机遇.  BigBench全球首次达到100TB  TPCx-BigBench是大数据端到端真实复杂的业界领先测试基准,目前,TPC官网公布的测试最大规模为10TB,最佳性能是1491.23BBQpm. 当天,阿里云与Inte

Openstack组建部署 — Glance Install

目录 目录 前文列表 Image service overview Openstack Image service包含的组件 Install and configure Prerequisites 先决条件 To create the database To create the service credentials Install and configure components Install the packages Edit the etcglanceglance-apiconf fi

GoldenGate DDL配置详解(原创)

前言 OS:RHEL 5.4   Oracle:10.2.0.1   GoldenGate:11.2.0.1 For Oracle 10g 注意事项: 1.用户的默认表空间不要指定为SYSTEM,否则在初始化DDL支持时可能会遇到段无法扩展,或包无法编译等错误. 正式应用的话,需要注意ogg用户所在表空间是否有充足的空间. 2.以SYSDBA身份登录到SQL*Plus,此时应该断开所有连接到ORACLE数据库的会话,并且不再允许创建新会话,仅保留刚刚创建的SYSDBA身份登录的SQL*Plus.