We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Data Science & Analytics/Identifying Dwarfs Workloads in Big Data Analytics
PeriodicalsData Science & Analytics

Identifying Dwarfs Workloads in Big Data Analytics

arXiv2015

Checking your access to this record.

Abstract & Overview

Big data benchmarking is particularly important and provides applicable yardsticks for evaluating booming big data systems. However, wide coverage and great complexity of big data computing impose big challenges on big data benchmarking. How can we construct a benchmark suite using a minimum set of units of computation to represent diversity of big data analytics workloads? Big data dwarfs are abstractions of extracting frequently appearing operations in big data computing. One dwarf represents one unit of computation, and big data workloads are decomposed into one or more dwarfs. Furthermore, dwarfs workloads rather than vast real workloads are more cost-efficient and representative to evaluate big data systems. In this paper, we extensively investigate six most important or emerging application domains i.e. search engine, social network, e-commerce, multimedia, bioinformatics and astronomy. After analyzing forty representative algorithms, we single out eight dwarfs workloads in big data analytics other than OLAP, which are linear algebra, sampling, logic operations, transform operations, set operations, graph operations, statistic operations and sort.

Cite this record

Wanling Gao, Chunjie Luo, Jianfeng Zhan, Hainan Ye, Xiwen He, Lei Wang, et al. (2015). Identifying Dwarfs Workloads in Big Data Analytics. arXiv. https://library.shubhaarti.com/content/7eeedd00-661b-4abd-a8ab-24a08bd72c73

Copy in another style

Gao, W., Luo, C., Zhan, J., Ye, H., He, X., Wang, L., Zhu, Y., & Tian, X. (2015). Identifying Dwarfs Workloads in Big Data Analytics. arXiv. https://library.shubhaarti.com/content/7eeedd00-661b-4abd-a8ab-24a08bd72c73
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.