Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blobstore docs zh #48

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 38 additions & 0 deletions docs/source/design/blobstore.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
纠删码子系统
=======================

纠删码子系统(BlobStore)是一个高可靠性、高可用、支持超大规模的分布式存储系统。采用纠删码中的Reed-Solomon编码,对比三副本,以更低的存储成本提供更高的数据耐久性保障,支持多种纠删码模式和多可用区部署,同时针对小文件做了专门优化,可满足不同业务场景的存储需求。
.. image:: ../pic/blobstore.png
:align: center
:alt: Blobstore Architecture
系统特性
--------------------------

- 超大规模

BlobStore可由多个cluster集群组成,单个cluster内可以存储数百PB以上的数据,cluster内部和cluster之间都支持水平弹性扩展,整个纠删码子系统可提供EB级别以上的超大规模存储需求解决方案。

- 高可靠性

BlobStore选择纠删码技术作为数据冗余备份策略,利用Reed-Solomon编码特性将原始数据分成N份数据块和M份校验块存储到集群,最大可以支持M份数据损坏的前提下保证数据可靠。BlobStore支持分区容错和容灾,支持数据自动巡检和修复,提供高达99.9999999999%的数据耐久性保障。


- 低成本

纠删码与三副本冗余备份技术在保障相同数据高可靠性的前提下,纠删码技术的存储冗余度远低于三副本技术。纠删码子系统在满足数据高可靠性的前提下更加节约存储成本,在大规模存储存储场景下收益明显。

- 灵活部署

BlobStore支持多种纠删码模式,可以自由配置纠删码中数据块和校验块份数以满足不同业务场景需求。支持单可用区到多个可用区的灵活部署。
.. image:: ../pic/multi-AZ.png
:align: center
:alt: Blobstore Multi-AZ Deployment

对外接口
---------------------

方法 | 参数|描述
---|---|---|---
Put |size,body,MD5【可选】|返回数据存储的位置信息location
Get | Location,offset,readsize|根据位置信息location、偏移量以及读取大小获取数据
Delete|location|根据location删除数据
2 changes: 1 addition & 1 deletion docs/source/design/client.rst
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
客户端
客户端v1.1
=========

客户端以用户态可执行程序的形式可以运行在容器中,并且通过FUSE将挂载的卷及文件系统接口提供给其它用户态应用。
Expand Down
Binary file added docs/source/design/pic/blobstore.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/source/design/pic/multi-AZ.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.