Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: 文件分发 & 存储 支持制品库 #2

Closed
ZhuoZhuoCrayon opened this issue Jul 29, 2021 · 1 comment
Closed

feature: 文件分发 & 存储 支持制品库 #2

ZhuoZhuoCrayon opened this issue Jul 29, 2021 · 1 comment
Assignees
@ZhuoZhuoCrayon
Labels
kind/feature 功能 version/V2.1.X V2.1.X 版本

Comments

@ZhuoZhuoCrayon
Copy link
Member

No description provided.

@ZhuoZhuoCrayon ZhuoZhuoCrayon self-assigned this Jul 29, 2021
@ZhuoZhuoCrayon ZhuoZhuoCrayon added the version/V2.1.X V2.1.X 版本 label Jul 29, 2021
@xyjunco xyjunco modified the milestone: 容器化 Jul 29, 2021
@ZhuoZhuoCrayon ZhuoZhuoCrayon changed the title feature: 文件分发支持制品库 feature: 文件分发 & 存储 支持制品库 Aug 10, 2021
@ZhuoZhuoCrayon
Copy link
Member Author

ZhuoZhuoCrayon commented Aug 10, 2021 •
edited
Loading

文件分发 & 存储 支持制品库预研

影响范围

  • Agent & Plugin 挂载 NFS 路径（/data/bkee/public/bknodeman/）的存储 及 下载
  • 作业平台文件分发
  • Agent手动安装curl获取安装包

Agent

wecom-temp-c5d4e2501bc9fbe918a6d2bdf8336f82

Plugin NFS

wecom-temp-2a701eefb38ca959f1ef7d4b0fbb1221

作业平台文件分发

wecom-temp-b6a34badae8c04be15e6f171c8b7c8cd

实现方案

通过环境变量配置文件「读取」& 「保存」的 存储类型

  • 抽象存储系统API：计划使用 -> File storage API
  • 根据环境变量返回 FileStorageClass

保持NFS & 对象存储 挂载路径的一致性

  • 保持原有路径 /data/bkee/public/bknodeman/ 不变
  • 服务器文件一次性迁移到对象存储平台，即可完成从NFS -> 对象存储的替换，无需关注DB层面

待定：抽象作业平台分发文件相关API

  • 分发路径不变的情况下，source的定义、job的版本有区分
  • 在各个业务逻辑分散实现，不利于代码维护

@zhangzhw8 @xyjunco

ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Aug 17, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (TencentBlueKing#2)
a4f9ea7
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Aug 17, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (TencentBlueKing#2)
05d39b7
@ZhuoZhuoCrayon ZhuoZhuoCrayon mentioned this issue Aug 17, 2021
Closed
@ZhuoZhuoCrayon ZhuoZhuoCrayon removed this from the 容器化 milestone Aug 20, 2021
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Aug 24, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (TencentBlueKing#2)
e9717f9 
feature: 插件包管理支持对象存储模式，公共方法优化整合 (TencentBlueKing#2)
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Aug 24, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (TencentBlueKing#2)
f090bbc 
feature: 插件包管理支持对象存储模式，公共方法优化整合 (TencentBlueKing#2)
This was referenced Aug 24, 2021
Closed
Merged
ZhuoZhuoCrayon added a commit that referenced this issue Aug 24, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
f9b4953 
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
This was referenced Aug 24, 2021
Closed
Closed
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Aug 31, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(TencentBlueKing#2)
c8b6494
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Sep 2, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (TencentBlueKing#2)
08024bc
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Sep 2, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(TencentBlueKing#2)
959b7bc
ZhuoZhuoCrayon added a commit that referenced this issue Sep 2, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
2f2d7b5
ZhuoZhuoCrayon added a commit that referenced this issue Sep 2, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
e6afa56
ZhuoZhuoCrayon added a commit that referenced this issue Sep 2, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
5238b37
@ZhuoZhuoCrayon ZhuoZhuoCrayon mentioned this issue Sep 2, 2021
Closed
ZhuoZhuoCrayon added a commit that referenced this issue Sep 2, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
ade19e9
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (TencentBlueKing#2)
0b8f559
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (TencentBlueKing#2)
214bc19
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (TencentBlueKing#2)
6344395
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (TencentBlueKing#2)
67b29c5
ZhuoZhuoCrayon added a commit that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (#2)
62991b5
ZhuoZhuoCrayon added a commit that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
12a60b2
ZhuoZhuoCrayon added a commit that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
4980d57
ZhuoZhuoCrayon added a commit that referenced this issue Sep 9, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (#2)
551e0ee
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
d93e20a
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
78f3222
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (#2)
b2a0300
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
optimization: 代码优化(#2)
60caa11
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
b9e4e8b
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
2c74ea5
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (#2)
649a6ad
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
optimization: 代码优化(#2)
44e2e8b
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
af1d0bf
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
31fe4b7
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (#2)
356813f
ZhuoZhuoCrayon added a commit that referenced this issue Sep 16, 2021
@ZhuoZhuoCrayon
optimization: 代码优化(#2)
8fa56f5
zhangzhw8 pushed a commit that referenced this issue Sep 22, 2021
@ZhuoZhuoCrayon @zhangzhw8
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
e548072
zhangzhw8 pushed a commit that referenced this issue Sep 22, 2021
@ZhuoZhuoCrayon @zhangzhw8
feature: 作业平台文件分发支持制品库(#2)
ea84901
zhangzhw8 pushed a commit that referenced this issue Sep 22, 2021
@ZhuoZhuoCrayon @zhangzhw8
test: 测试-插件包管理支持对象存储模式 (#2)
7d28390
zhangzhw8 pushed a commit that referenced this issue Sep 22, 2021
@ZhuoZhuoCrayon @zhangzhw8
optimization: 代码优化(#2)
4b91618
ZhuoZhuoCrayon added a commit to ZhuoZhuoCrayon/bk-nodeman that referenced this issue Sep 22, 2021
@ZhuoZhuoCrayon
minor: 文件分发 & 插件包管理支持对象存储模式(closed TencentBlueKing#2)
413bd79
zhangzhw8 pushed a commit that referenced this issue Sep 22, 2021
@ZhuoZhuoCrayon @zhangzhw8
minor: 文件分发 & 插件包管理支持对象存储模式(closed #2)
fccddd2
ZhuoZhuoCrayon added a commit that referenced this issue Sep 28, 2021
@ZhuoZhuoCrayon
feature: 插件包管理支持对象存储模式，公共方法优化整合 (#2)
eb25dbd
ZhuoZhuoCrayon added a commit that referenced this issue Sep 28, 2021
@ZhuoZhuoCrayon
feature: 作业平台文件分发支持制品库(#2)
76cb1e8
ZhuoZhuoCrayon added a commit that referenced this issue Sep 28, 2021
@ZhuoZhuoCrayon
test: 测试-插件包管理支持对象存储模式 (#2)
20d3bc6
ZhuoZhuoCrayon added a commit that referenced this issue Sep 28, 2021
@ZhuoZhuoCrayon
optimization: 代码优化(#2)
d32c109
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ZhuoZhuoCrayon ZhuoZhuoCrayon

Labels
kind/feature 功能 version/V2.1.X V2.1.X 版本
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@xyjunco @ZhuoZhuoCrayon