The implications from benchmarking three big data systems

Jing Quan, Yingjie Shi, Ming Zhao, Wei Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Along with today's data explosion and application diversification, a variety of hardware platforms for data centers are emerging and are attracting interests from both industry and academia. The existing hardware platforms represent a wide range of implementation approaches, and different hardware have different strengths. In this paper, we conduct comprehensive evaluations on three representative data center systems based on BigDataBench, which is a benchmark suite for benchmarking and ranking systems running big data applications. Then we explore the relative performance of the three implementation approaches with different big data applications, and provide strong guidance for the data center system construction. Through our experiments, we has inferred that a data center system based on specific hardware has different performance in the context of different applications and data volumes. When we construct a system, we can take into account not only the performance or energy consumption of the pure hardwares, but also the application-level characteristics. Data scale, application type and complexity should be considered comprehensively when researchers or architects plan to choose fundamental components for their data center system.

Original languageEnglish (US)
Title of host publicationProceedings - 2013 IEEE International Conference on Big Data, Big Data 2013
Pages31-38
Number of pages8
DOIs
StatePublished - 2013
Externally publishedYes
Event2013 IEEE International Conference on Big Data, Big Data 2013 - Santa Clara, CA, United States
Duration: Oct 6 2013Oct 9 2013

Other

Other2013 IEEE International Conference on Big Data, Big Data 2013
CountryUnited States
CitySanta Clara, CA
Period10/6/1310/9/13

Fingerprint

Benchmarking
Hardware
Explosions
Big data
Energy utilization
Industry
Experiments

ASJC Scopus subject areas

  • Software

Cite this

Quan, J., Shi, Y., Zhao, M., & Yang, W. (2013). The implications from benchmarking three big data systems. In Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013 (pp. 31-38). [6691706] https://doi.org/10.1109/BigData.2013.6691706

The implications from benchmarking three big data systems. / Quan, Jing; Shi, Yingjie; Zhao, Ming; Yang, Wei.

Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013. 2013. p. 31-38 6691706.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Quan, J, Shi, Y, Zhao, M & Yang, W 2013, The implications from benchmarking three big data systems. in Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013., 6691706, pp. 31-38, 2013 IEEE International Conference on Big Data, Big Data 2013, Santa Clara, CA, United States, 10/6/13. https://doi.org/10.1109/BigData.2013.6691706
Quan J, Shi Y, Zhao M, Yang W. The implications from benchmarking three big data systems. In Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013. 2013. p. 31-38. 6691706 https://doi.org/10.1109/BigData.2013.6691706
Quan, Jing ; Shi, Yingjie ; Zhao, Ming ; Yang, Wei. / The implications from benchmarking three big data systems. Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013. 2013. pp. 31-38
@inproceedings{3a1435efb63441d68b99f7f42b7fd33f,
title = "The implications from benchmarking three big data systems",
abstract = "Along with today's data explosion and application diversification, a variety of hardware platforms for data centers are emerging and are attracting interests from both industry and academia. The existing hardware platforms represent a wide range of implementation approaches, and different hardware have different strengths. In this paper, we conduct comprehensive evaluations on three representative data center systems based on BigDataBench, which is a benchmark suite for benchmarking and ranking systems running big data applications. Then we explore the relative performance of the three implementation approaches with different big data applications, and provide strong guidance for the data center system construction. Through our experiments, we has inferred that a data center system based on specific hardware has different performance in the context of different applications and data volumes. When we construct a system, we can take into account not only the performance or energy consumption of the pure hardwares, but also the application-level characteristics. Data scale, application type and complexity should be considered comprehensively when researchers or architects plan to choose fundamental components for their data center system.",
author = "Jing Quan and Yingjie Shi and Ming Zhao and Wei Yang",
year = "2013",
doi = "10.1109/BigData.2013.6691706",
language = "English (US)",
isbn = "9781479912926",
pages = "31--38",
booktitle = "Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013",

}

TY - GEN

T1 - The implications from benchmarking three big data systems

AU - Quan, Jing

AU - Shi, Yingjie

AU - Zhao, Ming

AU - Yang, Wei

PY - 2013

Y1 - 2013

N2 - Along with today's data explosion and application diversification, a variety of hardware platforms for data centers are emerging and are attracting interests from both industry and academia. The existing hardware platforms represent a wide range of implementation approaches, and different hardware have different strengths. In this paper, we conduct comprehensive evaluations on three representative data center systems based on BigDataBench, which is a benchmark suite for benchmarking and ranking systems running big data applications. Then we explore the relative performance of the three implementation approaches with different big data applications, and provide strong guidance for the data center system construction. Through our experiments, we has inferred that a data center system based on specific hardware has different performance in the context of different applications and data volumes. When we construct a system, we can take into account not only the performance or energy consumption of the pure hardwares, but also the application-level characteristics. Data scale, application type and complexity should be considered comprehensively when researchers or architects plan to choose fundamental components for their data center system.

AB - Along with today's data explosion and application diversification, a variety of hardware platforms for data centers are emerging and are attracting interests from both industry and academia. The existing hardware platforms represent a wide range of implementation approaches, and different hardware have different strengths. In this paper, we conduct comprehensive evaluations on three representative data center systems based on BigDataBench, which is a benchmark suite for benchmarking and ranking systems running big data applications. Then we explore the relative performance of the three implementation approaches with different big data applications, and provide strong guidance for the data center system construction. Through our experiments, we has inferred that a data center system based on specific hardware has different performance in the context of different applications and data volumes. When we construct a system, we can take into account not only the performance or energy consumption of the pure hardwares, but also the application-level characteristics. Data scale, application type and complexity should be considered comprehensively when researchers or architects plan to choose fundamental components for their data center system.

UR - http://www.scopus.com/inward/record.url?scp=84893272392&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893272392&partnerID=8YFLogxK

U2 - 10.1109/BigData.2013.6691706

DO - 10.1109/BigData.2013.6691706

M3 - Conference contribution

SN - 9781479912926

SP - 31

EP - 38

BT - Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013

ER -