Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VL][CI] update docker build script #3904

Merged
merged 9 commits into from
Dec 6, 2023
Merged

Conversation

zhouyuan
Copy link
Contributor

@zhouyuan zhouyuan commented Dec 1, 2023

What changes were proposed in this pull request?

this patch updates the docker build script for ubuntu/centos.
do not run setup scripts on centos 7 for static build, which is not necessary.

How was this patch tested?

pass GHA

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Copy link

github-actions bot commented Dec 1, 2023

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

Copy link

github-actions bot commented Dec 1, 2023

Run Gluten Clickhouse CI

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Copy link

github-actions bot commented Dec 4, 2023

Run Gluten Clickhouse CI

@zhouyuan zhouyuan marked this pull request as ready for review December 4, 2023 08:53
@zhouyuan zhouyuan changed the title [VL][CI] do not run update on centos 7 [VL][CI] do not run setup scripts on centos 7 for static build Dec 4, 2023
@zhouyuan zhouyuan changed the title [VL][CI] do not run setup scripts on centos 7 for static build [VL][CI] do not run setup scripts on centos 7 for static build, update docker build script Dec 4, 2023
@zhouyuan zhouyuan changed the title [VL][CI] do not run setup scripts on centos 7 for static build, update docker build script [VL][CI] update docker build script Dec 4, 2023
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Copy link

github-actions bot commented Dec 4, 2023

Run Gluten Clickhouse CI

1 similar comment
Copy link

github-actions bot commented Dec 4, 2023

Run Gluten Clickhouse CI

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@@ -93,6 +93,7 @@ RUN EXTRA_MAVEN_OPTIONS=$(cat ~/.gluten-mvn-options) \
DEPS_INSTALL_SCRIPT=$(cat ~/.gluten-deps-install-script) \
&& cd /opt/gluten \
&& bash -c "$DEPS_INSTALL_SCRIPT" \
&& bash -c "mvn clean install $GLUTEN_MAVEN_OPTIONS $EXTRA_MAVEN_OPTIONS"
&& bash -c "mvn clean install $GLUTEN_MAVEN_OPTIONS $EXTRA_MAVEN_OPTIONS" \
&& bash -c "mv ep/build-velox/build/velox_ep /opt/velox"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is to save velox build to /opt

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor: This would make libvelox.so unable to locate symbol source when debug build is enabled. Is there any reason to do it?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm preparing the pre-built docker image for GHA. In GHA The velox home is set to /opt/velox. by save the pre-built velox to /opt/velox can help to reuse the velox build before rebase happen. We could also try to copy the velox folder to /opt/ but it will occupy too many disk spaces

https://github.com/oap-project/gluten/blob/main/.github/workflows/velox_be.yml#L59

A proper way is to create separate docker files for dev, CI image purpose - we could follow up on this

&& cd /opt/gluten \
&& bash -c "$DEPS_INSTALL_SCRIPT" \
&& bash -c "mvn clean install $GLUTEN_MAVEN_OPTIONS $EXTRA_MAVEN_OPTIONS" \
&& bash -c "mv ep/build-velox/build/velox_ep /opt/velox"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is to save velox build to /opt

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@apache apache deleted a comment from github-actions bot Dec 4, 2023
@apache apache deleted a comment from github-actions bot Dec 4, 2023
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Copy link

github-actions bot commented Dec 5, 2023

Run Gluten Clickhouse CI

zhztheplayer
zhztheplayer previously approved these changes Dec 5, 2023
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@apache apache deleted a comment from github-actions bot Dec 5, 2023
Copy link

github-actions bot commented Dec 5, 2023

Run Gluten Clickhouse CI

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Copy link

github-actions bot commented Dec 5, 2023

Run Gluten Clickhouse CI

@zhouyuan zhouyuan merged commit 144fc45 into apache:main Dec 6, 2023
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants