Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pref: 日志模块ES存储性能优化 #7091

Closed
royalhuang opened this issue Jun 23, 2022 · 0 comments
Closed

pref: 日志模块ES存储性能优化 #7091

royalhuang opened this issue Jun 23, 2022 · 0 comments
Assignees
@royalhuang
Labels
area/ci/backend CI 后端issue done Production environment in tencent has been deploy for gray UAT environment in tencent has been deploy kind/feat/tech 技术性特性 todo todo

Comments

@royalhuang
Copy link
Collaborator

利用ES别名机制进行索引规划：

  • 超过600GB时自动利用别名机制创建新索引，引导新写入数据
  • 缓存别名当前的写索引
  • 使用定时任务执行分裂操作
  • 尽可能保持分片（副本）大小为30GB
@royalhuang royalhuang added kind/feat/tech 技术性特性 area/ci/backend CI 后端issue labels Jun 23, 2022
@royalhuang royalhuang self-assigned this Jun 23, 2022
@royalhuang royalhuang changed the title pref: 日志模块ES存储支持索引分裂提高存储性能 pref: 日志模块ES存储性能优化 Jan 8, 2025
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jan 8, 2025
pref: 日志模块ES存储性能优化 TencentBlueKing#7091 取消message字段索引
f376005
@bkci-bot bkci-bot added for test Test environment in tencent has been deploy todo todo labels Jan 8, 2025
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jan 9, 2025
pref: 日志模块ES存储性能优化 TencentBlueKing#7091 取消存储状态的默认值
481d81c
@royalhuang royalhuang mentioned this issue Jan 9, 2025
Merged
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jan 9, 2025
pref: 日志模块ES存储性能优化 TencentBlueKing#7091 修改产生存储的字段类型
1f897c8
@bkci-bot bkci-bot added todo todo and removed todo todo labels Jan 9, 2025
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jan 10, 2025
pref: 日志模块ES存储性能优化 TencentBlueKing#7091 修改产生存储的字段类型
ee7ffaa
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jan 10, 2025
pref: 日志模块ES存储性能优化 TencentBlueKing#7091 修改产生存储的字段类型
664cceb
@bkci-bot bkci-bot added for gray UAT environment in tencent has been deploy and removed for test Test environment in tencent has been deploy labels Jan 10, 2025
mingshewhe added a commit that referenced this issue Jan 10, 2025
@mingshewhe
Merge pull request #11398 from royalhuang/issue_7091
b4eb2bf 
pref: 日志模块ES存储性能优化 #7091
@bkci-bot bkci-bot added done Production environment in tencent has been deploy and removed for gray UAT environment in tencent has been deploy labels Jan 10, 2025
@bkci-bot bkci-bot added for test Test environment in tencent has been deploy todo todo for gray UAT environment in tencent has been deploy and removed todo todo for test Test environment in tencent has been deploy labels Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@royalhuang royalhuang

Labels
area/ci/backend CI 后端issue done Production environment in tencent has been deploy for gray UAT environment in tencent has been deploy kind/feat/tech 技术性特性 todo todo
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@royalhuang @bkci-bot