Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bugfix: [ipv6]第三方文件源分发文件，会产生重复的执行结果 #1563

Closed
wangyu096 opened this issue Dec 1, 2022 · 1 comment
Closed

bugfix: [ipv6]第三方文件源分发文件，会产生重复的执行结果 #1563

wangyu096 opened this issue Dec 1, 2022 · 1 comment
Assignees
@jsonwan
Labels
kind/bug 程序故障Bug，漏洞 stage/prod Production environment in tencent has been deploy

Comments

@wangyu096
Copy link
Collaborator

Version / Branch / tag

3.7.0-beta.41

出了什么问题？(What Happened?)
image

image

如图，只有一个文件从第三方文件源分发，但是在上传日志那里却又两条日志

如何复现？(How to reproduce?)

见问题描述

预期结果(What you expect?)

只有一条上传结果
@wangyu096 wangyu096 added the kind/bug 程序故障Bug，漏洞 label Dec 1, 2022
@wangyu096 wangyu096 self-assigned this Dec 1, 2022
@wangyu096
Copy link
Collaborator Author

缺陷原因：
第三方文件源的分发实际上分成两个阶段：

  1. 文件准备阶段：FileGateway/FileWorker从第三方文件源准备文件数据
  2. 文件分发阶段：Job-execute调用GSE API 进行源->目标的文件分发

由于文件准备产生的那条结果记录缺少hostId信息，导致拼接出来的结果记录ID出现错误，跟Job-execute产生的结果记录ID不一致，导致最终产生两条记录。

@jsonwan jsonwan assigned jsonwan and unassigned wangyu096 Dec 9, 2022
jsonwan added a commit to jsonwan/bk-job that referenced this issue Dec 10, 2022
@jsonwan
bugfix: [ipv6]第三方文件源分发文件，会产生重复的执行结果 TencentBlueKing#1563
b4b7046 
1. 第三方源文件准备过程日志保存前解析主机信息补充hostId；
2. file-gateway解除对api-logsvr的依赖。
jsonwan added a commit to jsonwan/bk-job that referenced this issue Dec 10, 2022
@jsonwan
bugfix: [ipv6]第三方文件源分发文件，会产生重复的执行结果 TencentBlueKing#1563
28020ea 
重构部分代码
jsonwan added a commit to jsonwan/bk-job that referenced this issue Dec 10, 2022
@jsonwan
bugfix: [ipv6]第三方文件源分发文件，会产生重复的执行结果 TencentBlueKing#1563
b420cdb 
修复产生重复日志条目的问题
jsonwan added a commit to jsonwan/bk-job that referenced this issue Dec 12, 2022
@jsonwan
bugfix: [ipv6]第三方文件源分发文件，会产生重复的执行结果 TencentBlueKing#1563
7a80e4b 
Review意见处理
wangyu096 added a commit that referenced this issue Dec 12, 2022
@wangyu096
Merge pull request #1606 from jsonwan/github_perf/third_file
5dd3c39 
bugfix: [ipv6]第三方文件源分发文件，会产生重复的执行结果 #1563
@bkjob-bot bkjob-bot added the stage/prod Production environment in tencent has been deploy label Dec 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jsonwan jsonwan

Labels
kind/bug 程序故障Bug，漏洞 stage/prod Production environment in tencent has been deploy
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@wangyu096 @jsonwan @bkjob-bot