Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix configuration errors #24

Merged
merged 1 commit into from
May 19, 2020
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -49,11 +49,12 @@
* 内存:8 GB
* 存储:100 GB, SSD

## 资源估算
## 资源估算(3副本标准配置)

* 存储空间(全集群):边数量 * 平均边属性的字节数 * 2.5
* 内存(全集群):边数量 * 4 字节 + RocksDB 实例数量 * (write_buffer_size * max_write_buffer_number + rocksdb_block_cache), 其中 `etc/nebula-storaged.conf` 文件中 `--data_path` 项中的每个目录对应一个 RocksDB 实例
* 存储空间(全集群):点和边数量 * 平均属性的字节数 * 6
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How did the 6 come from?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

点 * 平均属性的字节数 * 3 + 边 * 平均属性的字节数 * 6 + wal大小?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally, Edge count is much much larger than vertex count & wal. So I simplify the computation.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As in most cases, how many edges and vertices are only an estimation (e.g., about a 1 Billion). So I think it's not necessary to give a very accurate computation method.

* 内存(全集群):点边数量 * 5 字节 + RocksDB 实例数量 * (write_buffer_size * max_write_buffer_number + rocksdb_block_cache), 其中 `etc/nebula-storaged.conf` 文件中 `--data_path` 项中的每个目录对应一个 RocksDB 实例
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How did the 5 come from?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bloomfilter's 2.5 * (inkey + outkey)

* 图空间 partition 数量:全集群硬盘数量 * (2 至 10 —— 硬盘越好该值越大)
* 内存和硬盘另预留 20% buffer。

## 关于机械硬盘和千兆网络

Expand Down