Performance Evaluation on CXL-enabled Hybrid Memory Pool

Qirui Yang, Runyu Jin, Bridget Davis, Devasena Inupakutika, Ming Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The emerging cache coherent Compute Express Link (CXL) interconnect provides a practical way to disaggregate cloud memory resources from monolithic servers into memory pools with DRAM-level access latency. While DRAM-only memory pool improves the resource utilization and reduces the Total Cost of Ownership (TCO) for cloud providers, we investigate the possibility of applying cheaper SSDs to a memory pooling system to further reduce the cost of cloud servers without sacrificing the application's performance. In this study, we build a simulated CXL-enabled DRAM-SSD hybrid memory pool based on Linux and commodity hardware, and conduct performance evaluation by running representative cloud workloads which cover deep learning training, database, data analytics and video processing on the testbed. The evaluation results show that a hybrid memory pool can potentially reduce memory cost while maintaining the same level of application performance for computation-intensive applications. For example, with memory overcommit ratio of 2, the performance degradation of training ResNet50 on ImageNet dataset is only 2.68%.

Original languageEnglish (US)
Title of host publication2022 IEEE International Conference on Networking, Architecture and Storage, NAS 2022 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665454087
DOIs
StatePublished - 2022
Event16th IEEE International Conference on Networking, Architecture and Storage, NAS 2022 - Philadelphia, United States
Duration: Oct 3 2022Oct 4 2022

Publication series

Name2022 IEEE International Conference on Networking, Architecture and Storage, NAS 2022 - Proceedings

Conference

Conference16th IEEE International Conference on Networking, Architecture and Storage, NAS 2022
Country/TerritoryUnited States
CityPhiladelphia
Period10/3/2210/4/22

Keywords

  • CXL
  • DRAM
  • Hybrid Memory Pool
  • Memory Disaggregation
  • NUMA
  • NVMe
  • SSD

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Information Systems

Fingerprint

Dive into the research topics of 'Performance Evaluation on CXL-enabled Hybrid Memory Pool'. Together they form a unique fingerprint.

Cite this