Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

perf: 日志模块的相关熔断能力 #3772

Closed
royalhuang opened this issue Mar 10, 2021 · 0 comments
Closed

perf: 日志模块的相关熔断能力 #3772

royalhuang opened this issue Mar 10, 2021 · 0 comments
Assignees
@necrohuang @zhanxu33 @royalhuang
Labels
area/ci/agent 构建机Agent issue area/ci/backend CI 后端issue area/ci/frontend CI 前端特性issue done Production environment in tencent has been deploy for gray UAT environment in tencent has been deploy for test Test environment in tencent has been deploy grayed uat环境测试通过/test passed for uat stage kind/feat/tech 技术性特性 tested 测试环境通过/test patest passed for test stage
Milestone
v1.6

Comments

@royalhuang
Copy link
Collaborator

royalhuang commented Mar 10, 2021 •
edited
Loading

构建日志增加以下熔断机制：

  1. 单行日志长度上限（16KB）
  2. 单个插件日志打印量上限（100万行）
  3. worker本地先落盘，超过限制自动归档为日志文件

其中：

  1. 开源社区版因为不为构建日志设立LOG制品库，默认都走ES存储，落盘后均不进行归档
  2. 日志单行被截断时补充提示
@royalhuang royalhuang added help wanted Extra attention is needed area/ci/backend CI 后端issue kind/feat/tech 技术性特性 and removed help wanted Extra attention is needed labels Mar 10, 2021
@royalhuang royalhuang self-assigned this Mar 10, 2021
@irwinsun irwinsun added the area/ci/agent 构建机Agent issue label Mar 10, 2021
@irwinsun irwinsun added this to the 2021.3 (version 1.4) milestone Mar 10, 2021
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 25, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 增加开关控制的worker日志上报
c88c236
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 25, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 修复格式问题
c9f8874
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 25, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 补充启动配置加载
7ab58f8
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 25, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 修改构建机的构建日志打印目录
a256a92
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 29, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 优化配置逻辑
c216eea
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 29, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 优化获取日志路径逻辑
5e3c9ff
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 30, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 修改日志目录获取逻辑
55b40f4
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 30, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 只本地保存插件日志
8afa2d4
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 30, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 去掉创建log文件的过程
511e3f0
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 30, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 增加创建目录逻辑
a0c389f
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 30, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 增加和工作空间相同的构建日志初始化
ef5d890
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Mar 31, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 使用临时目录作为日志存放空间
12bcbdf
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 1, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 在job结束时进行日志文件归档
4045bc7
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 单个插件日志打印量上限100万行
9006241
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 单个插件日志打印量上限100万行
57ac14e
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 单个插件日志打印量上限100万行
553c3bf
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 修改本地日志标准路径
b6c1b04
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 将日志文件的子目录作为唯一标识
ec410e9
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 每个插件日志上限熔断策略独立
867ff13
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 每个插件日志上限熔断策略独立
614e829
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Apr 27, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 优化降级策略的部分逻辑
d31e24a
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 7, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 增加日志不可查看的提醒
b1cff05
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 7, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 增加日志不可查看的提醒
d84ae8e
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 7, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 修复启动插件没有上报结束状态
e0e1f25
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 7, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 恢复默认值
e7562dd
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 7, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 修复启动插件没有上报结束状态
4bfed3f
@zhanxu33 zhanxu33 mentioned this issue Jun 8, 2021
Merged
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 8, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 去掉jobId的传入
021d5d7
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 8, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 修改查询逻辑
c618b9c
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 8, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 修改更新逻辑
468cb24
@royalhuang royalhuang mentioned this issue Jun 8, 2021
Merged
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 8, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 增加数据库配置以及代码格式修复
2f65c1e
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 8, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 修改sql错误
b990161
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 8, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 去掉多余import
903de04
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 8, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 解决单行过长问题
96187bc
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 9, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 去掉误操作修改properties
cdbf1a1
@bkci-bot bkci-bot added the for test Test environment in tencent has been deploy label Jun 9, 2021
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 9, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 去掉多余的gradle文件
ff9ec18
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 15, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 更新提示逻辑
3108049
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 16, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 将插件日志重新加回agent运行日志
ca6d555
@royalhuang royalhuang added the tested 测试环境通过/test patest passed for test stage label Jun 29, 2021
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jun 30, 2021
perf: 日志模块的相关熔断能力 TencentBlueKing#3772 修改抛错的写法问题
c8000a1
irwinsun added a commit that referenced this issue Jun 30, 2021
@irwinsun
Merge pull request #4376 from royalhuang/issue_3772
beb30a1 
【先合3503】perf: 日志模块的相关熔断能力 #3772
lockiechen added a commit that referenced this issue Jul 1, 2021
@lockiechen
Merge pull request #4370 from zhanxu33/pref_3772_logDownload
506c591 
pref: 日志模块的相关熔断能力 issue #3772
royalhuang pushed a commit to royalhuang/bk-ci that referenced this issue Jul 1, 2021
pref: 日志模块的相关熔断能力 TencentBlueKing#3772 处理循环调用bug
7d8bdcb
@royalhuang royalhuang mentioned this issue Jul 1, 2021
Merged
irwinsun added a commit that referenced this issue Jul 1, 2021
@irwinsun
Merge pull request #4577 from royalhuang/issue_3772
c73caa7 
fix: 日志模块的相关熔断能力 #3772 处理循环调用bug
@bkci-bot bkci-bot added the for gray UAT environment in tencent has been deploy label Jul 1, 2021
@royalhuang royalhuang added the grayed uat环境测试通过/test passed for uat stage label Jul 7, 2021
@bkci-bot bkci-bot closed this as completed Jul 8, 2021
@bkci-bot bkci-bot added the done Production environment in tencent has been deploy label Jul 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@necrohuang necrohuang

@zhanxu33 zhanxu33

@royalhuang royalhuang

Labels
area/ci/agent 构建机Agent issue area/ci/backend CI 后端issue area/ci/frontend CI 前端特性issue done Production environment in tencent has been deploy for gray UAT environment in tencent has been deploy for test Test environment in tencent has been deploy grayed uat环境测试通过/test passed for uat stage kind/feat/tech 技术性特性 tested 测试环境通过/test patest passed for test stage
Projects
None yet
Milestone
v1.6
Development

No branches or pull requests
5 participants
@necrohuang @irwinsun @zhanxu33 @royalhuang @bkci-bot