Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Autoware.ai build is failing due to submodules not being detected correctly #2369

Open
MishkaMN opened this issue Apr 23, 2024 · 1 comment
Open

Autoware.ai build is failing due to submodules not being detected correctly #2369

MishkaMN opened this issue Apr 23, 2024 · 1 comment
Labels
anomaly Something isn't working

Comments

@MishkaMN
Copy link
Contributor

MishkaMN commented Apr 23, 2024 •
edited
Loading

Summary

Therare submodules defined in autoware.ai subdirectory that are not getting correctly detected by github submodule.
Not sure if this is something that always existed or something occurred due to our change
Since then, the build is failing saying it was not able to find url for its submodules (please see the long error message below):

#1 [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#eeaa1296f41c24378bb6a9de4971c4022435a0fd
#1 0.080 Initialized empty Git repository in /var/lib/buildkit/runc-overlayfs/snapshots/snapshots/1/fs/
#1 0.[115](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8624683047/job/23640077614#step:7:120) fatal: Not a valid object name eeaa1296f41c24378bb6a9de4971c4022435a0fd^{commit}
#1 11.08 From https://github.com/usdot-fhwa-stol/autoware.ai
#1 11.08  * [new branch]          bugfix/auto_builds      -> origin/bugfix/auto_builds
#1 11.08  * [new branch]          carma-develop           -> origin/carma-develop
#1 11.08  * [new branch]          carma-master            -> origin/carma-master
#1 11.08  * [new branch]          compilation-database    -> origin/compilation-database
#1 11.08  * [new branch]          feature/add_can2odom    -> origin/feature/add_can2odom
#1 11.08  * [new branch]          feature/add_gha         -> origin/feature/add_gha
#1 11.08  * [new branch]          feature/add_polymorphism_to_reg_elem -> origin/feature/add_polymorphism_to_reg_elem
#1 11.08  * [new branch]          feature/arm_port        -> origin/feature/arm_port
#1 11.08  * [new branch]          feature/bus_stop_sp     -> origin/feature/bus_stop_sp
#1 11.08  * [new branch]          feature/carla_bridge    -> origin/feature/carla_bridge
#1 11.08  * [new branch]          feature/carma_python_support -> origin/feature/carma_python_support
#1 11.08  * [new branch]          feature/ekf_timestamp   -> origin/feature/ekf_timestamp
#1 11.08  * [new branch]          feature/enhanced-build-warnings -> origin/feature/enhanced-build-warnings
#1 11.08  * [new branch]          feature/gear_change_update -> origin/feature/gear_change_update
#1 11.08  * [new branch]          feature/gitmodule       -> origin/feature/gitmodule
#1 11.08  * [new branch]          feature/ihp_develop_merge -> origin/feature/ihp_develop_merge
#1 11.08  * [new branch]          feature/lanelet2_participation_type -> origin/feature/lanelet2_participation_type
#1 11.08  * [new branch]          feature/lanelet2_update -> origin/feature/lanelet2_update
#1 11.08  * [new branch]          feature/mpc_controller  -> origin/feature/mpc_controller
#1 11.08  * [new branch]          feature/mpc_test        -> origin/feature/mpc_test
#1 11.08  * [new branch]          feature/msgs_ros1_and_ros2_compile_backup -> origin/feature/msgs_ros1_and_ros2_compile_backup
#1 11.08  * [new branch]          feature/ndt_with_imu    -> origin/feature/ndt_with_imu
#1 11.08  * [new branch]          feature/object_detection -> origin/feature/object_detection
#1 11.08  * [new branch]          feature/object_tracking -> origin/feature/object_tracking
#1 11.08  * [new branch]          feature/ros2_update_amathutils -> origin/feature/ros2_update_amathutils
#1 11.08  * [new branch]          feature/update_ci_for_ros2 -> origin/feature/update_ci_for_ros2
#1 11.08  * [new branch]          feature/update_ekf_tf_pub -> origin/feature/update_ekf_tf_pub
#1 11.08  * [new branch]          feature/update_tfhrc_full_map_tf -> origin/feature/update_tfhrc_full_map_tf
#1 11.08  * [new branch]          feature/voxel_grid_filter -> origin/feature/voxel_grid_filter
#1 11.08  * [new branch]          fix/cleaner_speed_limit_constraint -> origin/fix/cleaner_speed_limit_constraint
#1 11.09  * [new branch]          fix/jsk_common_msgs     -> origin/fix/jsk_common_msgs
#1 11.09  * [new branch]          fix/jsk_common_msgs_actually_working -> origin/fix/jsk_common_msgs_actually_working
#1 11.09  * [new branch]          fix/lanelet2_traffic_rules_install -> origin/fix/lanelet2_traffic_rules_install
#1 11.09  * [new branch]          fix/lanelet_or_area     -> origin/fix/lanelet_or_area
#1 11.09  * [new branch]          fix/message_install     -> origin/fix/message_install
#1 11.09  * [new branch]          fix/mrt_cmake_modules_install -> origin/fix/mrt_cmake_modules_install
#1 11.09  * [new branch]          fix/only_update_map_when_vehicle_changes_pos -> origin/fix/only_update_map_when_vehicle_changes_pos
#1 11.09  * [new branch]          fix/purepursuit_stopnwait -> origin/fix/purepursuit_stopnwait
#1 11.09  * [new branch]          fix/revert_ndt_matching -> origin/fix/revert_ndt_matching
#1 11.09  * [new branch]          fix/ros2_localization   -> origin/fix/ros2_localization
#1 11.09  * [new branch]          fix/rout_following      -> origin/fix/rout_following
#1 11.09  * [new branch]          fix/speed_limit_overwrite -> origin/fix/speed_limit_overwrite
#1 11.09  * [new branch]          fix/speed_limits        -> origin/fix/speed_limits
#1 11.09  * [new branch]          fix/vector_map_alignment -> origin/fix/vector_map_alignment
#1 11.09  * [new branch]          gha                     -> origin/gha
#1 11.09  * [new branch]          hotfix/higher_point_limit -> origin/hotfix/higher_point_limit
#1 11.09  * [new branch]          integration/autoware-1.12-upgrade -> origin/integration/autoware-1.12-upgrade
#1 11.09  * [new branch]          integration/autoware-1.13-alpha-upgrade -> origin/integration/autoware-1.13-alpha-upgrade
#1 11.09  * [new branch]          integration/autoware-1.13-prerelease -> origin/integration/autoware-1.13-prerelease
#1 11.09  * [new branch]          integration/ros_noetic  -> origin/integration/ros_noetic
#1 11.09  * [new branch]          noetic/develop          -> origin/noetic/develop
#1 11.09  * [new branch]          noetic/release          -> origin/noetic/release
#1 11.09  * [new branch]          refactor_lanelet2_extension -> origin/refactor_lanelet2_extension
#1 11.09  * [new branch]          release/a1              -> origin/release/a1
#1 11.09  * [new branch]          release/autobuild_test  -> origin/release/autobuild_test
#1 11.09  * [new branch]          release/cabin           -> origin/release/cabin
#1 11.09  * [new branch]          release/demo            -> origin/release/demo
#1 11.09  * [new branch]          release/fiesta          -> origin/release/fiesta
#1 11.09  * [new branch]          release/grayson_test    -> origin/release/grayson_test
#1 11.09  * [new branch]          release/isetta          -> origin/release/isetta
#1 11.09  * [new branch]          release/k900            -> origin/release/k900
#1 11.09  * [new branch]          release/lavida          -> origin/release/lavida
#1 11.09  * [new branch]          remove-build-wrapper    -> origin/remove-build-wrapper
#1 11.09  * [new branch]          resolve_conflicts       -> origin/resolve_conflicts
#1 11.09  * [new branch]          reusable-workflows      -> origin/reusable-workflows
#1 11.09  * [new branch]          revert-28-release/skyline -> origin/revert-28-release/skyline
#1 11.09  * [new branch]          revert-31-feature/update-autoware-version -> origin/revert-31-feature/update-autoware-version
#1 11.09  * [new branch]          sync-master-to-develop  -> origin/sync-master-to-develop
#1 11.09  * [new branch]          sync_develop_with_3_7   -> origin/sync_develop_with_3_7
#1 11.09  * [new branch]          sync_develop_with_elise -> origin/sync_develop_with_elise
#1 11.09  * [new branch]          sync_elise_with_master  -> origin/sync_elise_with_master
#1 11.09  * [new branch]          test/ekf_filter         -> origin/test/ekf_filter
#1 11.09  * [new branch]          test/localization_stack -> origin/test/localization_stack
#1 11.09  * [new branch]          test/master_voices      -> origin/test/master_voices
#1 11.09  * [new branch]          test/voices-pursuit-fix -> origin/test/voices-pursuit-fix
#1 11.09  * [new branch]          update-version-4.5.0    -> origin/update-version-4.5.0
#1 11.09  * [new tag]             carma-system-4.5.0      -> carma-system-4.5.0
#1 11.09  * [new tag]             sit1_rfr                -> sit1_rfr
#1 11.15  * [new tag]             1.0.0                   -> 1.0.0
#1 11.15  * [new tag]             1.0.1                   -> 1.0.1
#1 11.15  * [new tag]             1.1.0                   -> 1.1.0
#1 11.15  * [new tag]             1.1.1                   -> 1.1.1
#1 11.15  * [new tag]             1.1.2                   -> 1.1.2
#1 11.15  * [new tag]             1.10.0                  -> 1.10.0
#1 11.15  * [new tag]             1.11.0                  -> 1.11.0
#1 11.15  * [new tag]             1.2.0                   -> 1.2.0
#1 11.15  * [new tag]             1.3.0                   -> 1.3.0
#1 11.16  * [new tag]             1.3.1                   -> 1.3.1
#1 11.16  * [new tag]             1.4.0                   -> 1.4.0
#1 11.16  * [new tag]             1.5.0                   -> 1.5.0
#1 11.16  * [new tag]             1.5.1                   -> 1.5.1
#1 11.16  * [new tag]             1.6.0                   -> 1.6.0
#1 11.16  * [new tag]             1.6.1                   -> 1.6.1
#1 11.16  * [new tag]             1.6.2                   -> 1.6.2
#1 11.16  * [new tag]             1.6.3                   -> 1.6.3
#1 11.16  * [new tag]             1.7.0                   -> 1.7.0
#1 11.16  * [new tag]             1.8.0                   -> 1.8.0
#1 11.16  * [new tag]             1.9.0                   -> 1.9.0
#1 11.16  * [new tag]             1.9.1                   -> 1.9.1
#1 11.16  * [new tag]             CARMASystem_3.1.0       -> CARMASystem_3.1.0
#1 11.16  * [new tag]             CARMASystem_3.2.0       -> CARMASystem_3.2.0
#1 11.16  * [new tag]             Version_3.0.0           -> Version_3.0.0
#1 11.16  * [new tag]             autoware.ai-3.8.2       -> autoware.ai-3.8.2
#1 11.16  * [new tag]             autoware.ai-3.9.0       -> autoware.ai-3.9.0
#1 11.16  * [new tag]             autoware.ai_3.0.0       -> autoware.ai_3.0.0
#1 11.16  * [new tag]             autoware.ai_3.1.0       -> autoware.ai_3.1.0
#1 11.16  * [new tag]             autoware.ai_3.2.0       -> autoware.ai_3.2.0
#1 11.16  * [new tag]             autoware.ai_3.3.0       -> autoware.ai_3.3.0
#1 11.16  * [new tag]             autoware.ai_3.4.0       -> autoware.ai_3.4.0
#1 11.16  * [new tag]             autoware.ai_3.5.0       -> autoware.ai_3.5.0
#1 11.16  * [new tag]             autoware.ai_3.6.0       -> autoware.ai_3.6.0
#1 11.16  * [new tag]             autoware.ai_3.7.0       -> autoware.ai_3.7.0
#1 11.16  * [new tag]             autoware.ai_3.8.0       -> autoware.ai_3.8.0
#1 11.16  * [new tag]             autoware.ai_3.8.1       -> autoware.ai_3.8.1
#1 11.16  * [new tag]             carma-system-3.10.0     -> carma-system-3.10.0
#1 11.16  * [new tag]             carma-system-3.11.0     -> carma-system-3.11.0
#1 11.16  * [new tag]             carma-system-3.4.0      -> carma-system-3.4.0
#1 11.16  * [new tag]             carma-system-3.4.1      -> carma-system-3.4.1
#1 11.16  * [new tag]             carma-system-3.4.2      -> carma-system-3.4.2
#1 11.16  * [new tag]             carma-system-3.4.3      -> carma-system-3.4.3
#1 11.16  * [new tag]             carma-system-3.5.0      -> carma-system-3.5.0
#1 11.16  * [new tag]             carma-system-3.5.3      -> carma-system-3.5.3
#1 11.16  * [new tag]             carma-system-3.6.0      -> carma-system-3.6.0
#1 11.16  * [new tag]             carma-system-3.7.0      -> carma-system-3.7.0
#1 11.16  * [new tag]             carma-system-3.8.0      -> carma-system-3.8.0
#1 11.16  * [new tag]             carma-system-3.9.0      -> carma-system-3.9.0
#1 11.16  * [new tag]             carma-system-4.0.0      -> carma-system-4.0.0
#1 11.16  * [new tag]             carma-system-4.0.3      -> carma-system-4.0.3
#1 11.16  * [new tag]             carma-system-4.1.0      -> carma-system-4.1.0
#1 11.16  * [new tag]             carma-system-4.2.0      -> carma-system-4.2.0
#1 11.16  * [new tag]             carma-system-4.3.0      -> carma-system-4.3.0
#1 11.16  * [new tag]             carma-system-4.4.0      -> carma-system-4.4.0
#1 13.82 fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules
#1 ERROR: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status 128
stderr:
fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules

------
 > [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#eeaa1296f41c24378bb6a9de4971c4022435a0fd:
11.16  * [new tag]             carma-system-3.7.0      -> carma-system-3.7.0
11.16  * [new tag]             carma-system-3.8.0      -> carma-system-3.8.0
11.16  * [new tag]             carma-system-3.9.0      -> carma-system-3.9.0
11.16  * [new tag]             carma-system-4.0.0      -> carma-system-4.0.0
11.16  * [new tag]             carma-system-4.0.3      -> carma-system-4.0.3
11.16  * [new tag]             carma-system-4.1.0      -> carma-system-4.1.0
11.16  * [new tag]             carma-system-4.2.0      -> carma-system-4.2.0
11.16  * [new tag]             carma-system-4.3.0      -> carma-system-4.3.0
11.16  * [new tag]             carma-system-4.4.0      -> carma-system-4.4.0
13.82 fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules
------
ERROR: failed to solve: failed to read dockerfile: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status [128](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8624683047/job/23640077614#step:7:133)
stderr:
fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules

Original can be seen from this: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8624698002/job/23640117337

When moving these submodule declarations into the root directory of the repository, submodules are detected but it still was not possible to clone the repositories with following unknown error:

#0 building with "builder-d96ce27e-2b94-4238-b169-b5d4327c3d3b" instance using docker-container driver

#1 [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#refs/pull/271/merge
#1 0.042 Initialized empty Git repository in /var/lib/buildkit/runc-overlayfs/snapshots/snapshots/1/fs/
#1 0.399 b7cc23d1c9e0bb7ad0eb1130b4afd5c8427b686d	refs/pull/271/merge
#1 8.510 From https://github.com/usdot-fhwa-stol/autoware.ai
#1 8.510  * [new ref]         refs/pull/271/merge -> refs/pull/271/merge
#1 11.08 Submodule 'jsk_common_msgs/.travis' (git://github.com/jsk-ros-pkg/jsk_travis) registered for path 'jsk_common_msgs/.travis'
#1 11.08 Submodule 'jsk_recognition/.travis' (https://github.com/jsk-ros-pkg/jsk_travis.git) registered for path 'jsk_recognition/.travis'
#1 11.08 Submodule 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort' (https://github.com/nwojke/deep_sort.git) registered for path 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'
#1 11.08 Submodule 'jsk_recognition/jsk_perception/slic' (https://github.com/garaemon/SLIC-Superpixels.git) registered for path 'jsk_recognition/jsk_perception/slic'
#1 11.08 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
#1 146.1 fatal: unable to connect to github.com:
#1 146.1 github.com[0: 140.82.[113](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8791371654/job/24125441576#step:4:118).3]: errno=Operation timed out
#1 146.1 
#1 146.1 fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
#1 146.1 Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
#1 146.1 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
#1 146.3 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
#1 146.5 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
#1 146.7 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
#1 281.3 fatal: unable to connect to github.com:
#1 281.3 github.com[0: 140.82.113.3]: errno=Operation timed out
#1 281.3 
#1 281.3 fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
#1 281.3 Failed to clone 'jsk_common_msgs/.travis' a second time, aborting
#1 ERROR: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status 1
stderr:
Submodule 'jsk_common_msgs/.travis' (git://github.com/jsk-ros-pkg/jsk_travis) registered for path 'jsk_common_msgs/.travis'
Submodule 'jsk_recognition/.travis' (https://github.com/jsk-ros-pkg/jsk_travis.git) registered for path 'jsk_recognition/.travis'
Submodule 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort' (https://github.com/nwojke/deep_sort.git) registered for path 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'
Submodule 'jsk_recognition/jsk_perception/slic' (https://github.com/garaemon/SLIC-Superpixels.git) registered for path 'jsk_recognition/jsk_perception/slic'
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis' a second time, aborting

------
 > [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#refs/pull/271/merge:
146.1 Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
146.1 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
146.3 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
146.5 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
146.7 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
281.3 fatal: unable to connect to github.com:
281.3 github.com[0: 140.82.113.3]: errno=Operation timed out
281.3 
281.3 fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
281.3 Failed to clone 'jsk_common_msgs/.travis' a second time, aborting
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
ERROR: failed to solve: failed to read dockerfile: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status 1
stderr:
Submodule 'jsk_common_msgs/.travis' (git://github.com/jsk-ros-pkg/jsk_travis) registered for path 'jsk_common_msgs/.travis'
Submodule 'jsk_recognition/.travis' (https://github.com/jsk-ros-pkg/jsk_travis.git) registered for path 'jsk_recognition/.travis'
Submodule 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort' (https://github.com/nwojke/deep_sort.git) registered for path 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'
Submodule 'jsk_recognition/jsk_perception/slic' (https://github.com/garaemon/SLIC-Superpixels.git) registered for path 'jsk_recognition/jsk_perception/slic'
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis' a second time, aborting

Original can be seen from this action: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8791371654/job/24125441576

Which leds me to believe (I could be wrong) that these submodules were never really cloned AND not needed.
They were added in 4.0.0 as part of fork from autoware, and the packages we build don't seem to need them:
please check this PR where basically removed the submodules usdot-fhwa-stol/autoware.ai#268
And the build succeeds: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8630864827/job/23658072373?pr=268

However, I am not sure whether if this will fail at run-time or fail on features that we do not use currently such as any perception involved operations.

Version

4.5.0 (Current)

Expected Behavior

See above

Actual Behavior

See above

Steps to Reproduce the Actual Behavior

See above

Related Work

No response
@MishkaMN MishkaMN added the anomaly Something isn't working label Apr 23, 2024
@MishkaMN MishkaMN mentioned this issue Apr 23, 2024
Merged
9 tasks
@MishkaMN
Copy link
Contributor Author

MishkaMN commented Apr 23, 2024 •
edited
Loading

Interstingly, when we trigger build image with top of carma-develop branch, we are able to build the image, which I am assuming it skips the git cloning operation and builds from "cached builds"?. However, if that is the case, I am still little confused how it was able to build the cached one from the beginning:

Run docker/build-push-action@v3
GitHub Actions runtime token access controls
Docker info
Buildx version
  
/usr/bin/docker buildx build --iidfile /tmp/docker-build-push-UIfUNE/iidfile --tag usdotfhwastoldev/autoware.ai:develop --metadata-file /tmp/docker-build-push-UIfUNE/metadata-file --push .
#0 building with "builder-d5441fe6-8542-419c-a968-a4d0b669d5c8" instance using docker-container driver
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.18kB done
#1 DONE 0.0s
#2 [internal] load metadata for docker.io/usdotfhwastoldev/carma-base:develop
#2 ...
#3 [auth] usdotfhwastoldev/carma-base:pull token for registry-1.docker.io
#3 DONE 0.0s
#2 [internal] load metadata for docker.io/usdotfhwastoldev/carma-base:develop
#2 DONE 0.7s
#4 [internal] load .dockerignore
#4 transferring context: 500B done
#4 DONE 0.0s
#5 [base_image 1/1] FROM docker.io/usdotfhwastoldev/carma-base:develop@sha256:a5b9[21](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8793203268/job/24130696780#step:5:23)b6f0dc550ecabc47e3706323e8bfa14da67600aae56795f8e985056c8a
#5 resolve docker.io/usdotfhwastoldev/carma-base:develop@sha256:a5b921b6f0dc550ecabc47e3706323e8bfa14da67600aae56795f8e985056c8a done
#5 DONE 0.1s
#6 [internal] load build context
#6 transferring context: 491.36MB 4.8s done
#6 DONE 4.8s

Action: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8793203268/job/24130696780

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
anomaly Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@MishkaMN