• 中文核心期刊要目总览
  • 中国科技核心期刊
  • 中国科学引文数据库(CSCD)
  • 中国科技论文与引文数据库(CSTPCD)
  • 中国学术期刊文摘数据库(CSAD)
  • 中国学术期刊(网络版)(CNKI)
  • 中文科技期刊数据库
  • 万方数据知识服务平台
  • 中国超星期刊域出版平台
  • 国家科技学术期刊开放平台
  • 荷兰文摘与引文数据库(SCOPUS)
  • 日本科学技术振兴机构数据库(JST)

分布式内存存储系统上的混合容错

Hybrid fault tolerance in distributed in-memory storage systems

  • 摘要: 内存存储系统提供亚毫秒级的延迟,通过在内存中缓存外部存储的数据来提高用户应用程序的并发性。内存存储系统的容错非常有必要,因为缓存数据的丢失导致需要从外部存储中访问数据,这将明显增加响应延迟。多副本和纠删码是两种典型的容错方式,它们在访问性能和存储开销间做出了不同的权衡。为了有助于实现最佳的性能和空间平衡,我们设计了一种混合容错分布式内存存储系统ElasticMem,该系统支持弹性的冗余转换,以动态改变容错方案。ElasticMem利用一种新的面向纠删码的多副本,它根据以后数据使用纠删码存储时的数据布局,来精心设计其数据布局,以提高冗余转换的I/O效率。ElasticMem通过基于表的轻量方案并结合数据旁路,解决了并发数据访问引起的一致性问题。它检测相关的读写请求,并利用本地数据回应后面的读请求。我们基于Memcached实现了一个ElasticMem原型系统。实验表明,ElasticMem显著降低了冗余转换的时间、相关并发数据访问的总体延迟和其中单个数据访问的延迟。

     

    Abstract: An in-memory storage system provides submillisecond latency and improves the concurrency of user applications by caching data into memory from external storage. Fault tolerance of in-memory storage systems is essential, as the loss of cached data requires access to data from external storage, which evidently increases the response latency. Typically, replication and erasure code (EC) are two fault-tolerant schemes that pose different trade-offs between access performance and storage usage. To help make the best performance and space trade-off, we design ElasticMem, a hybrid fault-tolerant distributed in-memory storage system that supports elastic redundancy transition to dynamically change the fault-tolerant scheme. ElasticMem exploits a novel EC-oriented replication (EOR) that carefully designs the data placement of replication according to the future data layout of EC to enhance the I/O efficiency of redundancy transition. ElasticMem solves the consistency problem caused by concurrent data accesses via a lightweight table-based scheme combined with data bypassing. It detects correlated read and write requests and serves subsequent read requests with local data. We implement a prototype that realizes ElasticMem based on Memcached. Experiments show that ElasticMem remarkably reduces the time of redundancy transition, the overall latency of correlated concurrent data accesses, and the latency of single data access among them.

     

/

返回文章
返回