Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

removing use of semaphore cache as the public semaphore will not have cache #145

Merged
merged 25 commits into from
Jul 21, 2023
Merged

removing use of semaphore cache as the public semaphore will not have cache #145

Changes from 24 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
e4c02bd
removing use of semaphore cache as the public semaphore will not have
jkuhnashconfluent Jul 10, 2023
4b8fbef
test removing settings.xml to get dep resolution output via public repos
jkuhnashconfluent Jul 11, 2023
48ff090
remove settings.xml to get test output as well
jkuhnashconfluent Jul 11, 2023
70603d9
re-add caching to see output after changing to public maven.org
jkuhnashconfluent Jul 11, 2023
5c6bf2a
tweak to test m2
jkuhnashconfluent Jul 11, 2023
fa6e0b9
store .m2 and target as a tgz in artifact
jkuhnashconfluent Jul 14, 2023
d71ea07
rm confluent codeartifact mvn settings
jkuhnashconfluent Jul 14, 2023
c6126a0
remove artifacts before upload
jkuhnashconfluent Jul 14, 2023
ef0d720
create initial create-post.tgz
jkuhnashconfluent Jul 14, 2023
35363e5
re-enable delete
jkuhnashconfluent Jul 14, 2023
02bdb54
dont delete
jkuhnashconfluent Jul 14, 2023
6f48f71
delete and disable CodeArtifact
jkuhnashconfluent Jul 14, 2023
d97d88a
test no cache but using cache.tgz instead
jkuhnashconfluent Jul 14, 2023
e00598d
try public
jkuhnashconfluent Jul 14, 2023
e85d33d
unzip cache.tgz for tests
jkuhnashconfluent Jul 14, 2023
867108f
considerations for full lifecycle and design
jkuhnashconfluent Jul 14, 2023
6572e8a
file rename
jkuhnashconfluent Jul 14, 2023
9aadf1a
reorder
jkuhnashconfluent Jul 14, 2023
9503c7f
retain settings.xml until full public migration process
jkuhnashconfluent Jul 17, 2023
4e9c561
rm ~/.m2/settings.xml
jkuhnashconfluent Jul 17, 2023
b2564d5
removing the initial cache.tgz step which unpacks for mvn install
jkuhnashconfluent Jul 17, 2023
66f28af
baseline back to no cache
jkuhnashconfluent Jul 20, 2023
e899065
refactor to utilize workflow level caching to publish the built
jkuhnashconfluent Jul 20, 2023
e1154ff
add comment to explain need to cache .m2 and target
xvrl Jul 20, 2023
c204660
add comment for why we remove .m2/settings.xml
xvrl Jul 20, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 12 additions & 4 deletions .semaphore/semaphore.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,8 @@ name: Apache Druid
agent:
machine:
type: s1-prod-ubuntu20-04-amd64-1

execution_time_limit:
hours: 3
jkuhnashconfluent marked this conversation as resolved.
Show resolved Hide resolved
blocks:
- name: "Install"
task:
Expand Down Expand Up @@ -33,11 +34,16 @@ blocks:
jobs:
- name: "Install"
commands:
- cache restore
# This is a change meant to validate semaphore public builds
# so thus removing configurations for Confluent's internal CodeArtifact
- rm ~/.m2/settings.xml
xvrl marked this conversation as resolved.
Show resolved Hide resolved
- >
MAVEN_OPTS="${MAVEN_OPTS} -Xmx3000m" ${MVN} clean install
-q -ff ${MAVEN_SKIP} ${MAVEN_SKIP_TESTS} -T1C
- cache store
# downstream tests depend on artifacts installed by mvn install into .m2
# also cache target to avoid the cost of recompiling tests
- tar zcf cache-post-install.tgz .m2 target
xvrl marked this conversation as resolved.
Show resolved Hide resolved
- artifact push workflow cache-post-install.tgz

- name: "Tests"
task:
Expand All @@ -47,7 +53,9 @@ blocks:
- echo $SEMAPHORE_WORKFLOW_ID
- sem-version java 17
- checkout
- cache restore
- artifact pull workflow cache-post-install.tgz
- tar zxf cache-post-install.tgz
- rm ~/.m2/settings.xml
xvrl marked this conversation as resolved.
Show resolved Hide resolved
jobs:
- name: "animal sniffer checks"
commands:
Expand Down