Buildfarmer log 2024/09/30 - 2024/10/07

[github-actions]

Previous log #97

[github-actions]

Sep 30

Urgent

Build regressions

Reference Build	Failure DateTime	Failure Reason
nightly_win_deb#3232	2024-09-30 04:00	Packages rviz_ogre_vendor Failed
nightly_win_rel#3185	2024-09-30 04:00	Packages rviz_ogre_vendor Failed
nightly_win_rep#3495	2024-09-30 04:00	Packages rviz_ogre_vendor Failed
packaging_windows#3385	2024-09-30 04:00	Packages rviz_ogre_vendor Failed
Rci__nightly-fastrtps_ubuntu_noble_amd64#150	2024-09-29 22:50	Number of failed test exceeds the threshold

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Rci__nightly-connext_ubuntu_noble_amd64#159	18	2024-09-29 14:35:53.038000	projectroot.test.rclcpp.test_generic_service rclcpp.TestGenericService.generic_service_qos	No reports found!
nightly_linux-rhel_repeated#2042	5	2024-09-29 04:00:01.168000	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#59	4	2024-09-29 06:15:01.637000	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#131	3	2024-09-29 03:22:08.146000	projectroot.test.test_performance_CycloneDDS_sync_Array8m projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS	No reports found!

Test regressions flaky

Test regressions

Reference builds	Errors	Flaky report	Reports
Rci__nightly-performance_ubuntu_noble_amd64#116 Jci__nightly-performance_ubuntu_noble_amd64#40	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 4 3 75.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-28 2024-09-25 14 3 21.43%	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#40	projectroot.test.test_performance_CycloneDDS_sync_Array8m	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 4 3 75.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-27 2024-09-27 14 1 7.14%	No reports found!
nightly_linux_humble_coverage#948	launch_testing_ros.test.examples.wait_for_topic_launch_test.wait_for_topic_launch_test	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_linux_humble_coverage 2024-09-29 2024-09-16 13 6 46.15% nightly_linux_iron_coverage 2024-09-24 2024-09-17 12 3 25.0% nightly_linux-rhel_repeated 2024-09-24 2024-09-23 15 2 13.33%	https://github.com/ros2/launch_ros/issues/304 (Closed)
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	projectroot.test_cli_remapping	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-27 2024-09-18 12 4 33.33% Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-09-30 2024-09-30 6 1 16.67% nightly_linux-aarch64_repeated 2024-09-21 2024-09-18 16 2 12.5%	No reports found!
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	launch_testing_examples.launch_testing_examples.check_multiple_nodes_launch_test.launch_testing_examples.check_multiple_nodes_launch_test	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_linux-aarch64_repeated 2024-09-29 2024-09-17 16 4 25.0% Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-09-30 2024-09-30 6 1 16.67% nightly_linux-rhel_repeated 2024-09-27 2024-09-20 15 2 13.33% nightly_linux_repeated 2024-09-23 2024-09-23 13 1 7.69%	https://github.com/ros2/examples/issues/340 (Closed)
Jci__nightly-debug_ubuntu_noble_amd64#55	projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Jci__nightly-debug_ubuntu_noble_amd64 2024-09-29 2024-09-29 5 1 20.0% nightly_linux-rhel_repeated 2024-09-20 2024-09-15 15 3 20.0% nightly_linux_repeated 2024-09-16 2024-09-16 13 1 7.69%	No reports found!
nightly_linux-rhel_repeated#2042	projectroot.test_node_name__rmw_fastrtps_cpp test_rclcpp.test_node_name__rmw_fastrtps_cpp.xunit.missing_result	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_linux-aarch64_repeated 2024-09-23 2024-09-20 16 3 18.75% nightly_linux-rhel_repeated 2024-09-29 2024-09-29 15 1 6.67%	No reports found!

Maintenance

Jobs last success date

Job Name	Last Success
Hci__nightly-connext_ubuntu_jammy_amd64	Never
Ici__nightly-connext_ubuntu_jammy_amd64	Never
Rci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-8-win	Never
gz_rendering-7-win	Never
Jci__nightly-connext_ubuntu_noble_amd64	Never
Jci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-9-win	Never
nightly_win_rep	2024-01-12
Rci__nightly-connext_ubuntu_noble_amd64	2024-05-04
nightly_linux_coverage	2024-05-24
nightly_win_deb	2024-06-03
gz_rendering-ign-rendering6-win	2024-07-02
gz_transport-ci-gz-transport12-homebrew-amd64	2024-07-07
gz_rendering-ign-rendering3-win	2024-07-07
gz_transport-ci-ign-transport11-homebrew-amd64	2024-07-08
nightly_linux_repeated	2024-08-14
gz_sim-ci-gz-sim8-jammy-amd64	2024-09-15
Ici__nightly-performance_ubuntu_jammy_amd64	2024-09-17
nightly_linux-rhel_repeated	2024-09-17
Jci__nightly-performance_ubuntu_noble_amd64	2024-09-17
gz_sim-ign-gazebo6-win	2024-09-19
nightly_linux-rhel_debug	2024-09-22
gz_transport-ci-gz-transport13-jammy-amd64	2024-09-22
gz_transport-ci-gz-transport13-noble-amd64	2024-09-22
gz_transport-ci-ign-transport11-focal-amd64	2024-09-22

Pending

Test regressions all

Reference Build	Error Name
nightly_linux_repeated#3596	launch_testing_examples.launch_testing_examples.hello_world_launch_test.launch_testing_examples.hello_world_launch_test (age: 1)
nightly_linux_humble_coverage#948	launch_testing_ros.test.examples.wait_for_topic_launch_test.wait_for_topic_launch_test (age: 1)
nightly_linux_coverage#2537	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (age: 12)
nightly_linux-rhel_repeated#2042	test_rclcpp.test_node_name__rmw_fastrtps_cpp.xunit.missing_result (age: 1)
gz_transport-ci-ign-transport11-homebrew-amd64#80	ignTest.TopicInfo (age: 23)
gz_sim-ign-gazebo6-win#91	ServerRepeat/MultipleServers.TwoServersNonBlocking/0 (age: 1)
gz_sim-ci-gz-sim9-noble-amd64#17	UNIT_Server_TEST.test_ran (age: 1)
gz_rendering-9-win#17	71 errors VisualTest.Clone (age: 17)
gz_rendering-8-win#89	70 errors VisualTest.Clone (age: 20)
gz_rendering-7-win#81	67 errors VisualTest.Clone (age: 20)
Rci__nightly-performance_ubuntu_noble_amd64#116	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 2)
Rci__nightly-connext_ubuntu_noble_amd64#159	12 errors rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset (age: 159)
Rci__benchmark_ubuntu_noble_amd64#110	projectroot.benchmark_string_conversions (age: 110)
Jci__nightly-performance_ubuntu_noble_amd64#40	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 1)
Jci__nightly-debug_ubuntu_noble_amd64#55	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp (age: 1)
Jci__nightly-connext_ubuntu_noble_amd64#59	13 errors rclpy.rclpy.test.test_client.TestClient.test_service_timestamps (age: 1)
Jci__benchmark_ubuntu_noble_amd64#39	projectroot.benchmark_string_conversions (age: 39)
Ici__nightly-performance_ubuntu_jammy_amd64#131	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 3)
Ici__nightly-connext_ubuntu_jammy_amd64#171	11 errors launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 72)
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	18 errors test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/tmp/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] (age: 1)
Hci__nightly-connext_ubuntu_jammy_amd64#278	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 9)

Test regressions known

Ros

Open issues

Issue	Jobs Name	Errors Name
https://github.com/ros2/demos/issues/693	nightly_win_rep nightly_win_deb nightly_linux-rhel_repeated	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output projectroot.test_tutorial_parameter_events_async__rmw_connextdds projectroot.test_tutorial_parameter_events__rmw_connextdds
https://github.com/ros2/rosidl/issues/812	nightly_linux_coverage	projectroot.test_multi_nested_message_introspection rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
https://github.com/ros2/rcl/issues/1162	nightly_win_deb	projectroot.test_action_interaction__rmw_connextdds rcl_action.TestActionClientServerInteraction.test_interaction rcl_action.TestActionClientServerInteraction.test_interaction_with_cancel
https://github.com/ros2/rclcpp/issues/2582	Jci__nightly-connext_ubuntu_noble_amd64 Rci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_service rclcpp.TestService.server_qos projectroot.test.rclcpp.test_client_common rclcpp.TestAllClientTypesWithServer/Client.client_qos rclcpp.TestAllClientTypesWithServer/GenericClient.client_qos
https://github.com/ros2/rmw_connextdds/issues/155	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	11 errors projectroot.test.rclcpp.test_client rclcpp.TestClient.on_new_response_callback projectroot.test.rclcpp.test_qos_event rclcpp.TestQosEvent.test_on_new_event_callback rclcpp.TestQosEvent.test_invalid_on_new_event_callback projectroot.test.rclcpp.test_service rclcpp.TestService.on_new_request_callback projectroot.test.rclcpp.test_subscription rclcpp.TestSubscription.on_new_message_callback projectroot.test.rclcpp.test_executors rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
https://github.com/ros2/rclcpp/issues/2588	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
https://github.com/ros2/rosidl_typesupport_fastrtps/issues/119	Rci__benchmark_ubuntu_noble_amd64 Jci__benchmark_ubuntu_noble_amd64	projectroot.benchmark_string_conversions
https://github.com/ros2/launch_ros/issues/408	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
https://github.com/ros2/rclcpp/issues/2611	Ici__nightly-connext_ubuntu_jammy_amd64	rclcpp.TestClient.client_qos
https://github.com/ros2/examples/issues/391	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
https://github.com/ros2/rclpy/issues/1347	Hci__nightly-connext_ubuntu_jammy_amd64	projectroot.test_client rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
https://github.com/ros2/rclcpp/issues/2613	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
https://github.com/ros2/launch/issues/796	nightly_linux_coverage	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Gazebo

Open issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-rendering/issues/745	gz_rendering-7-win gz_rendering-8-win gz_rendering-9-win	71 errors CameraTest.ViewProjectionMatrix CameraTest.RenderTexture CameraTest.TrackFollow CameraTest.AddRemoveRenderPass CameraTest.VisibilityMask CameraTest.IntrinsicMatrix GpuRaysTest.Configure LidarVisualTest.Configure LidarVisualTest.LidarVisual ProjectorTest.Projector SceneTest.Scene SceneTest.SceneGradient SceneTest.Nodes SceneTest.RemoveNodes SceneTest.DestroyNodes SceneTest.NodeCycle SceneTest.Materials SceneTest.Time SceneTest.BackgroundMaterial ThermalCameraTest.ThermalCamera ReloadEngineTest.Scene ArrowVisualTest.ArrowVisual AxisVisualTest.AxisVisual COMVisualTest.COMVisual CapsuleTest.Capsule GizmoVisualTest.GizmoVisual GizmoVisualTest.Material GridTest.Grid InertiaVisualTest.InertiaVisual LightVisualTest.LightVisual LightTest.Light MarkerTest.Marker MaterialTest.MaterialProperties MeshDescriptorTest.Descriptor MeshTest.MeshSubMesh MeshTest.MeshSkeleton MeshTest.MeshSkeletonAnimation MeshTest.MeshClone MoveToHelperTest.MoveTo NodeTest.Pose OrbitViewControllerTest.OrbitViewControl OrbitViewControllerTest.Constructor OrbitViewControllerTest.Control OrthoViewControllerTest.OrthoViewControl OrthoViewControllerTest.Control ParticleEmitterTest.ParticleEmitter RayQueryTest.RayQuery RenderTargetTest.RenderTexture RenderTargetTest.RenderWindow RenderTargetTest.AddRemoveRenderPass RenderingIfaceTest.GetEngine TextTest.Text TransformControllerTest.TransformControl TransformControllerTest.WorldSpace TransformControllerTest.LocalSpace TransformControllerTest.Control2d VisualTest.Material VisualTest.Children VisualTest.Scale VisualTest.UserData VisualTest.Geometry VisualTest.VisibilityFlags VisualTest.BoundingBox VisualTest.Wireframe VisualTest.Clone WavesTest.Waves MeshTest.NormalMapWithoutTexCoord GizmoVisualTest.LookAt FontTestInstantiation/FontTest.SupportedFont/0 FontTestInstantiation/FontTest.SupportedFont/1 FontTestInstantiation/FontTest.SupportedFont/2
https://github.com/gazebosim/gz-transport/issues/509	gz_transport-ci-gz-transport12-homebrew-amd64	UNIT_gz_TEST.xml.[failed-to-read]
https://github.com/gazebosim/gz-transport/issues/510	gz_transport-ci-ign-transport11-homebrew-amd64	ignTest.TopicInfo

Disabled issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-transport/issues/195	gz_transport-ign-transport8-win gz_transport-ign-transport11-win gz_transport-12-win gz_transport-13-win	playback.ReplayStep
https://github.com/gazebosim/gz-rendering/issues/847	gz_rendering-ci-ign-rendering3-homebrew-amd64 gz_rendering-ci-ign-rendering6-homebrew-amd64	34 errors UNIT_Visual_TEST.test_ran UNIT_TransformController_TEST.test_ran UNIT_ThermalCamera_TEST.test_ran UNIT_Scene_TEST.test_ran UNIT_RenderingIface_TEST.test_ran UNIT_RenderTarget_TEST.test_ran UNIT_RayQuery_TEST.test_ran UNIT_OrbitViewController_TEST.test_ran UNIT_Node_TEST.test_ran UNIT_MoveToHelper_TEST.test_ran UNIT_Mesh_TEST.test_ran UNIT_Material_TEST.test_ran UNIT_Marker_TEST.test_ran UNIT_Light_TEST.test_ran UNIT_Grid_TEST.test_ran UNIT_Camera_TEST.test_ran UNIT_AxisVisual_TEST.test_ran UNIT_ArrowVisual_TEST.test_ran INTEGRATION_shadows.test_ran INTEGRATION_scene.test_ran INTEGRATION_render_pass.test_ran INTEGRATION_depth_camera.test_ran INTEGRATION_camera.test_ran INTEGRATION_thermal_camera.test_ran INTEGRATION_gpu_rays.test_ran INTEGRATION_lidar_visual.test_ran UNIT_Capsule_TEST.test_ran UNIT_Heightmap_TEST.test_ran UNIT_JointVisual_TEST.test_ran UNIT_LidarVisual_TEST.test_ran UNIT_LightVisual_TEST.test_ran UNIT_OrthoViewController_TEST.test_ran UNIT_Text_TEST.test_ran UNIT_WireBox_TEST.test_ran
https://github.com/gazebosim/gz-sim/issues/1887	gz_sim-ci-ign-gazebo6-homebrew-amd64	.gz-sim.python.test.testFixture_TEST

[Blast545]

INVESTIGATION: new test failing in https://build.osrfoundation.org/job/gz_sim-ci-gz-sim8-jammy-amd64/153/

INTEGRATION_reset_sensors. seems there was a change in physics or sensors triggering this, full investigation pending

[github-actions]

Oct 01

Urgent

Build regressions

Reference Build	Failure DateTime	Failure Reason
nightly_win_deb#3233	2024-10-01 04:00	Packages rviz_ogre_vendor Failed
nightly_win_rel#3186	2024-10-01 04:00	Packages rviz_ogre_vendor Failed
nightly_win_rep#3496	2024-10-01 04:00	Packages rviz_ogre_vendor Failed
packaging_windows#3386	2024-10-01 04:00	Packages rviz_ogre_vendor Failed
packaging_windows_debug#2349	2024-10-01 04:36	Packages rviz_ogre_vendor Failed

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Rci__nightly-connext_ubuntu_noble_amd64#160	19	2024-09-30 08:47:44.435000	projectroot.test.rclcpp.test_generic_service rclcpp.TestGenericService.generic_service_qos	No reports found!
nightly_linux-rhel_repeated#2045	8	2024-10-01 04:00:01.110000	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#59	4	2024-09-29 06:15:01.637000	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#131	3	2024-09-29 03:22:08.146000	projectroot.test.test_performance_CycloneDDS_sync_Array8m projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS	No reports found!

Test regressions flaky

Test regressions

Reference builds	Errors	Flaky report	Reports
Jci__nightly-performance_ubuntu_noble_amd64#40 Hci__nightly-performance_ubuntu_jammy_amd64#269	projectroot.test.test_performance_CycloneDDS_sync_Array8m projectroot.test.test_performance_CycloneDDS_sync_Array8m	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 4 3 75.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Hci__nightly-performance_ubuntu_jammy_amd64 2024-10-01 2024-10-01 6 1 16.67% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-27 2024-09-27 13 1 7.69%	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#40 Hci__nightly-performance_ubuntu_jammy_amd64#269	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 4 3 75.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-28 2024-09-25 13 3 23.08% Hci__nightly-performance_ubuntu_jammy_amd64 2024-10-01 2024-10-01 6 1 16.67%	No reports found!
nightly_linux-rhel_repeated#2045	projectroot.test_n_nodes__rmw_fastrtps_cpp test_rclcpp.TestNNodesAfterShutdown.test_10_nodes	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-29 2024-09-16 11 7 63.64% nightly_linux_repeated 2024-09-22 2024-09-22 12 1 8.33% nightly_win_rel 2024-09-21 2024-09-21 14 1 7.14% nightly_linux-rhel_repeated 2024-10-01 2024-10-01 15 1 6.67% nightly_linux-aarch64_repeated 2024-09-23 2024-09-23 16 1 6.25%	No reports found!
nightly_linux-rhel_repeated#2045	test_rclcpp.TestNNodes.test_10_nodes	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-29 2024-09-16 11 7 63.64% nightly_linux_repeated 2024-09-22 2024-09-22 12 1 8.33% nightly_linux-rhel_repeated 2024-10-01 2024-10-01 15 1 6.67% nightly_linux-aarch64_repeated 2024-09-23 2024-09-23 16 1 6.25%	No reports found!
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	projectroot.test_cli_remapping	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-27 2024-09-18 11 4 36.36% Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-09-30 2024-09-30 5 1 20.0% nightly_linux-aarch64_repeated 2024-09-21 2024-09-18 16 2 12.5%	No reports found!
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	launch_testing_examples.launch_testing_examples.check_multiple_nodes_launch_test.launch_testing_examples.check_multiple_nodes_launch_test	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_linux-aarch64_repeated 2024-09-29 2024-09-17 16 4 25.0% Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-09-30 2024-09-30 5 1 20.0% nightly_linux-rhel_repeated 2024-09-27 2024-09-20 15 2 13.33% nightly_linux_repeated 2024-09-23 2024-09-23 12 1 8.33%	https://github.com/ros2/examples/issues/340 (Closed)

Maintenance

Jobs last success date

Job Name	Last Success
Hci__nightly-connext_ubuntu_jammy_amd64	Never
Ici__nightly-connext_ubuntu_jammy_amd64	Never
Rci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-8-win	Never
gz_rendering-7-win	Never
Jci__nightly-connext_ubuntu_noble_amd64	Never
Jci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-9-win	Never
nightly_win_rep	2024-01-12
Rci__nightly-connext_ubuntu_noble_amd64	2024-05-04
nightly_linux_coverage	2024-05-24
nightly_win_deb	2024-06-03
gz_rendering-ign-rendering6-win	2024-07-02
gz_rendering-ign-rendering3-win	2024-07-07
gz_transport-ci-ign-transport11-homebrew-amd64	2024-07-08
nightly_linux_repeated	2024-08-14
Ici__nightly-performance_ubuntu_jammy_amd64	2024-09-17
nightly_linux-rhel_repeated	2024-09-17
Jci__nightly-performance_ubuntu_noble_amd64	2024-09-17
gz_sim-ign-gazebo6-win	2024-09-19
nightly_linux-rhel_debug	2024-09-22
gz_transport-ci-gz-transport13-jammy-amd64	2024-09-22
gz_transport-ci-gz-transport13-noble-amd64	2024-09-22
gz_transport-ci-ign-transport11-focal-amd64	2024-09-22
gz_transport-ci-ign-transport8-focal-amd64	2024-09-23
gz_utils-ci-gz-utils2-focal-amd64	2024-09-23
gz_utils-ci-gz-utils2-jammy-amd64	2024-09-23
gz_utils-ci-gz-utils2-noble-amd64	2024-09-23
gz_utils-ci-ign-utils1-focal-amd64	2024-09-23
sdformat-ci-sdf12-focal-amd64	2024-09-23
sdformat-ci-sdf13-focal-amd64	2024-09-23
sdformat-ci-sdf14-jammy-amd64	2024-09-23
sdformat-ci-sdf14-noble-amd64	2024-09-23
sdformat-ci-sdf9-focal-amd64	2024-09-23

Pending

Test regressions all

Reference Build	Error Name
nightly_linux_coverage#2539	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (age: 14)
nightly_linux-rhel_repeated#2045	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes (age: 1)
nightly_linux-rhel_debug#2059	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn (age: 1)
nightly_linux-aarch64_repeated#2901	launch_testing_examples.launch_testing_examples.hello_world_launch_test.launch_testing_examples.hello_world_launch_test (age: 1)
gz_transport-ci-ign-transport11-homebrew-amd64#81	ignTest.TopicInfo (age: 24)
gz_transport-14-win#14	playback.ReplayStep (age: 1)
gz_sim-ign-gazebo6-win#91	ServerRepeat/MultipleServers.TwoServersNonBlocking/0 (age: 1)
gz_rendering-9-win#18	71 errors VisualTest.Clone (age: 18)
gz_rendering-8-win#89	70 errors VisualTest.Clone (age: 20)
gz_rendering-7-win#81	67 errors VisualTest.Clone (age: 20)
Rci__nightly-fastrtps_ubuntu_noble_amd64#151	11 errors ros2service.ros2service.test.test_cli.test_cli (age: 1)
Rci__nightly-cyclonedds_ubuntu_noble_amd64#157	ros2service.ros2service.test.test_cli.test_cli (age: 1)
Rci__nightly-connext_ubuntu_noble_amd64#160	10 errors rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset (age: 160)
Rci__benchmark_ubuntu_noble_amd64#111	projectroot.benchmark_string_conversions (age: 111)
Jci__nightly-performance_ubuntu_noble_amd64#40	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 1)
Jci__nightly-debug_ubuntu_noble_amd64#55	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp (age: 1)
Jci__nightly-connext_ubuntu_noble_amd64#59	13 errors rclpy.rclpy.test.test_client.TestClient.test_service_timestamps (age: 1)
Jci__benchmark_ubuntu_noble_amd64#39	projectroot.benchmark_string_conversions (age: 39)
Ici__nightly-performance_ubuntu_jammy_amd64#131	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 3)
Ici__nightly-cyclonedds_ubuntu_jammy_amd64#168	ros2topic.ros2topic.test.test_cli.test_cli (age: 1)
Ici__nightly-connext_ubuntu_jammy_amd64#172	11 errors launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 73)
Hci__nightly-performance_ubuntu_jammy_amd64#269	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 1)
Hci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#281	ros2lifecycle.ros2lifecycle.test.test_cli.test_cli (age: 1)
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	18 errors test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/tmp/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] (age: 1)
Hci__nightly-connext_ubuntu_jammy_amd64#278	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 9)

Test regressions known

Ros

Open issues

Issue	Jobs Name	Errors Name
https://github.com/ros2/demos/issues/693	nightly_win_rep nightly_win_deb nightly_linux-rhel_repeated	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output projectroot.test_tutorial_parameter_events_async__rmw_connextdds projectroot.test_tutorial_parameter_events__rmw_connextdds
https://github.com/ros2/rosidl/issues/812	nightly_linux_coverage	projectroot.test_multi_nested_message_introspection rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
https://github.com/ros2/rcl/issues/1162	nightly_win_deb	projectroot.test_action_interaction__rmw_connextdds rcl_action.TestActionClientServerInteraction.test_interaction rcl_action.TestActionClientServerInteraction.test_interaction_with_cancel
https://github.com/ros2/rclcpp/issues/2582	Jci__nightly-connext_ubuntu_noble_amd64 Rci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_service rclcpp.TestService.server_qos projectroot.test.rclcpp.test_client_common rclcpp.TestAllClientTypesWithServer/Client.client_qos rclcpp.TestAllClientTypesWithServer/GenericClient.client_qos
https://github.com/ros2/rmw_connextdds/issues/155	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	11 errors projectroot.test.rclcpp.test_client rclcpp.TestClient.on_new_response_callback projectroot.test.rclcpp.test_qos_event rclcpp.TestQosEvent.test_on_new_event_callback rclcpp.TestQosEvent.test_invalid_on_new_event_callback projectroot.test.rclcpp.test_service rclcpp.TestService.on_new_request_callback projectroot.test.rclcpp.test_subscription rclcpp.TestSubscription.on_new_message_callback projectroot.test.rclcpp.test_executors rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
https://github.com/ros2/rclcpp/issues/2588	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
https://github.com/ros2/rosidl_typesupport_fastrtps/issues/119	Rci__benchmark_ubuntu_noble_amd64 Jci__benchmark_ubuntu_noble_amd64	projectroot.benchmark_string_conversions
https://github.com/ros2/launch_ros/issues/408	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
https://github.com/ros2/rclcpp/issues/2611	Ici__nightly-connext_ubuntu_jammy_amd64	rclcpp.TestClient.client_qos
https://github.com/ros2/examples/issues/391	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
https://github.com/ros2/rclpy/issues/1347	Hci__nightly-connext_ubuntu_jammy_amd64	projectroot.test_client rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
https://github.com/ros2/rclcpp/issues/2613	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
https://github.com/ros2/launch/issues/796	nightly_linux_coverage	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Gazebo

Open issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-rendering/issues/745	gz_rendering-7-win gz_rendering-8-win gz_rendering-9-win	71 errors CameraTest.ViewProjectionMatrix CameraTest.RenderTexture CameraTest.TrackFollow CameraTest.AddRemoveRenderPass CameraTest.VisibilityMask CameraTest.IntrinsicMatrix GpuRaysTest.Configure LidarVisualTest.Configure LidarVisualTest.LidarVisual ProjectorTest.Projector SceneTest.Scene SceneTest.SceneGradient SceneTest.Nodes SceneTest.RemoveNodes SceneTest.DestroyNodes SceneTest.NodeCycle SceneTest.Materials SceneTest.Time SceneTest.BackgroundMaterial ThermalCameraTest.ThermalCamera ReloadEngineTest.Scene ArrowVisualTest.ArrowVisual AxisVisualTest.AxisVisual COMVisualTest.COMVisual CapsuleTest.Capsule GizmoVisualTest.GizmoVisual GizmoVisualTest.Material GridTest.Grid InertiaVisualTest.InertiaVisual LightVisualTest.LightVisual LightTest.Light MarkerTest.Marker MaterialTest.MaterialProperties MeshDescriptorTest.Descriptor MeshTest.MeshSubMesh MeshTest.MeshSkeleton MeshTest.MeshSkeletonAnimation MeshTest.MeshClone MoveToHelperTest.MoveTo NodeTest.Pose OrbitViewControllerTest.OrbitViewControl OrbitViewControllerTest.Constructor OrbitViewControllerTest.Control OrthoViewControllerTest.OrthoViewControl OrthoViewControllerTest.Control ParticleEmitterTest.ParticleEmitter RayQueryTest.RayQuery RenderTargetTest.RenderTexture RenderTargetTest.RenderWindow RenderTargetTest.AddRemoveRenderPass RenderingIfaceTest.GetEngine TextTest.Text TransformControllerTest.TransformControl TransformControllerTest.WorldSpace TransformControllerTest.LocalSpace TransformControllerTest.Control2d VisualTest.Material VisualTest.Children VisualTest.Scale VisualTest.UserData VisualTest.Geometry VisualTest.VisibilityFlags VisualTest.BoundingBox VisualTest.Wireframe VisualTest.Clone WavesTest.Waves MeshTest.NormalMapWithoutTexCoord GizmoVisualTest.LookAt FontTestInstantiation/FontTest.SupportedFont/0 FontTestInstantiation/FontTest.SupportedFont/1 FontTestInstantiation/FontTest.SupportedFont/2
https://github.com/gazebosim/gz-transport/issues/509	gz_transport-ci-gz-transport12-homebrew-amd64	UNIT_gz_TEST.xml.[failed-to-read]
https://github.com/gazebosim/gz-transport/issues/510	gz_transport-ci-ign-transport11-homebrew-amd64	ignTest.TopicInfo

Disabled issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-transport/issues/195	gz_transport-ign-transport8-win gz_transport-ign-transport11-win gz_transport-12-win gz_transport-13-win	playback.ReplayStep
https://github.com/gazebosim/gz-rendering/issues/847	gz_rendering-ci-ign-rendering3-homebrew-amd64 gz_rendering-ci-ign-rendering6-homebrew-amd64	34 errors UNIT_Visual_TEST.test_ran UNIT_TransformController_TEST.test_ran UNIT_ThermalCamera_TEST.test_ran UNIT_Scene_TEST.test_ran UNIT_RenderingIface_TEST.test_ran UNIT_RenderTarget_TEST.test_ran UNIT_RayQuery_TEST.test_ran UNIT_OrbitViewController_TEST.test_ran UNIT_Node_TEST.test_ran UNIT_MoveToHelper_TEST.test_ran UNIT_Mesh_TEST.test_ran UNIT_Material_TEST.test_ran UNIT_Marker_TEST.test_ran UNIT_Light_TEST.test_ran UNIT_Grid_TEST.test_ran UNIT_Camera_TEST.test_ran UNIT_AxisVisual_TEST.test_ran UNIT_ArrowVisual_TEST.test_ran INTEGRATION_shadows.test_ran INTEGRATION_scene.test_ran INTEGRATION_render_pass.test_ran INTEGRATION_depth_camera.test_ran INTEGRATION_camera.test_ran INTEGRATION_thermal_camera.test_ran INTEGRATION_gpu_rays.test_ran INTEGRATION_lidar_visual.test_ran UNIT_Capsule_TEST.test_ran UNIT_Heightmap_TEST.test_ran UNIT_JointVisual_TEST.test_ran UNIT_LidarVisual_TEST.test_ran UNIT_LightVisual_TEST.test_ran UNIT_OrthoViewController_TEST.test_ran UNIT_Text_TEST.test_ran UNIT_WireBox_TEST.test_ran
https://github.com/gazebosim/gz-sim/issues/1887	gz_sim-ci-ign-gazebo6-homebrew-amd64	.gz-sim.python.test.testFixture_TEST

[Blast545]

Investigation: something happened with rviz_ogre_vendor, and all windows builds are red

[clalancette]

Investigation: something happened with rviz_ogre_vendor, and all windows builds are red

git.savannah.gnu.org (where we get freetype from) was down overnight, and is still down.

[claraberendsen]

2024-10-01 Gazebo test regressions

There seems to be no new regressions on the buildfarm.

New forward port to disable replayStep on transport14 gazebosim/gz-transport#546. It's flaky and has been disabled everywhere else.

[github-actions]

Oct 02

Urgent

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Rci__nightly-connext_ubuntu_noble_amd64#160	19	2024-09-30 08:47:44.435000	projectroot.test.rclcpp.test_generic_service rclcpp.TestGenericService.generic_service_qos	No reports found!
nightly_linux-rhel_repeated#2045	8	2024-10-01 04:00:01.110000	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#59	4	2024-09-29 06:15:01.637000	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#131	3	2024-09-29 03:22:08.146000	projectroot.test.test_performance_CycloneDDS_sync_Array8m projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS	No reports found!

Test regressions flaky

Test regressions

Reference builds	Errors	Flaky report	Reports
Jci__nightly-performance_ubuntu_noble_amd64#40 Hci__nightly-performance_ubuntu_jammy_amd64#269	projectroot.test.test_performance_CycloneDDS_sync_Array8m projectroot.test.test_performance_CycloneDDS_sync_Array8m	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 4 3 75.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Hci__nightly-performance_ubuntu_jammy_amd64 2024-10-01 2024-10-01 5 1 20.0% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-27 2024-09-27 12 1 8.33%	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#40 Hci__nightly-performance_ubuntu_jammy_amd64#269	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 4 3 75.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-28 2024-09-25 12 3 25.0% Hci__nightly-performance_ubuntu_jammy_amd64 2024-10-01 2024-10-01 5 1 20.0%	No reports found!
nightly_linux-rhel_repeated#2045	projectroot.test_n_nodes__rmw_fastrtps_cpp test_rclcpp.TestNNodesAfterShutdown.test_10_nodes	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-29 2024-09-17 10 6 60.0% nightly_linux_repeated 2024-09-22 2024-09-22 11 1 9.09% nightly_win_rel 2024-09-21 2024-09-21 13 1 7.69% nightly_linux-rhel_repeated 2024-10-01 2024-10-01 14 1 7.14% nightly_linux-aarch64_repeated 2024-09-23 2024-09-23 15 1 6.67%	No reports found!
nightly_linux-rhel_repeated#2045	test_rclcpp.TestNNodes.test_10_nodes	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-29 2024-09-17 10 6 60.0% nightly_linux_repeated 2024-09-22 2024-09-22 11 1 9.09% nightly_linux-rhel_repeated 2024-10-01 2024-10-01 14 1 7.14% nightly_linux-aarch64_repeated 2024-09-23 2024-09-23 15 1 6.67%	No reports found!
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	projectroot.test_cli_remapping	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-27 2024-09-18 10 4 40.0% Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-09-30 2024-09-30 5 1 20.0% nightly_linux-aarch64_repeated 2024-09-21 2024-09-18 15 2 13.33%	No reports found!
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	launch_testing_examples.launch_testing_examples.check_multiple_nodes_launch_test.launch_testing_examples.check_multiple_nodes_launch_test	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_linux-aarch64_repeated 2024-09-29 2024-09-17 15 4 26.67% Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-09-30 2024-09-30 5 1 20.0% nightly_linux-rhel_repeated 2024-09-27 2024-09-20 14 2 14.29% nightly_linux_repeated 2024-09-23 2024-09-23 11 1 9.09%	https://github.com/ros2/examples/issues/340 (Closed)

Maintenance

Jobs last success date

Job Name	Last Success
Hci__nightly-connext_ubuntu_jammy_amd64	Never
Ici__nightly-connext_ubuntu_jammy_amd64	Never
Rci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-8-win	Never
gz_rendering-7-win	Never
Jci__nightly-connext_ubuntu_noble_amd64	Never
Jci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-9-win	Never
nightly_win_rep	2024-01-12
Rci__nightly-connext_ubuntu_noble_amd64	2024-05-04
nightly_linux_coverage	2024-05-24
nightly_win_deb	2024-06-03
gz_rendering-ign-rendering6-win	2024-07-02
gz_rendering-ign-rendering3-win	2024-07-07
gz_transport-ci-ign-transport11-homebrew-amd64	2024-07-08
nightly_linux_repeated	2024-08-14
Ici__nightly-performance_ubuntu_jammy_amd64	2024-09-17
nightly_linux-rhel_repeated	2024-09-17
Jci__nightly-performance_ubuntu_noble_amd64	2024-09-17
gz_sim-ign-gazebo6-win	2024-09-19
nightly_linux-rhel_debug	2024-09-22
gz_transport-ci-gz-transport13-jammy-amd64	2024-09-22
gz_transport-ci-gz-transport13-noble-amd64	2024-09-22
gz_transport-ci-ign-transport11-focal-amd64	2024-09-22
gz_transport-ci-ign-transport8-focal-amd64	2024-09-23
gz_utils-ci-gz-utils2-focal-amd64	2024-09-23
gz_utils-ci-gz-utils2-jammy-amd64	2024-09-23
gz_utils-ci-gz-utils2-noble-amd64	2024-09-23
gz_utils-ci-ign-utils1-focal-amd64	2024-09-23
sdformat-ci-sdf12-focal-amd64	2024-09-23
sdformat-ci-sdf13-focal-amd64	2024-09-23
sdformat-ci-sdf14-jammy-amd64	2024-09-23
sdformat-ci-sdf14-noble-amd64	2024-09-23
sdformat-ci-sdf9-focal-amd64	2024-09-23

Pending

Test regressions all

Reference Build	Error Name
nightly_linux_coverage#2539	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (age: 14)
nightly_linux-rhel_repeated#2045	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes (age: 1)
nightly_linux-rhel_debug#2059	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn (age: 1)
nightly_linux-aarch64_repeated#2901	launch_testing_examples.launch_testing_examples.hello_world_launch_test.launch_testing_examples.hello_world_launch_test (age: 1)
gz_transport-ci-ign-transport11-homebrew-amd64#81	ignTest.TopicInfo (age: 24)
gz_transport-14-win#14	playback.ReplayStep (age: 1)
gz_sim-ign-gazebo6-win#91	ServerRepeat/MultipleServers.TwoServersNonBlocking/0 (age: 1)
gz_rendering-9-win#18	71 errors VisualTest.Clone (age: 18)
gz_rendering-7-win#81	67 errors VisualTest.Clone (age: 20)
Rci__nightly-fastrtps_ubuntu_noble_amd64#151	11 errors ros2service.ros2service.test.test_cli.test_cli (age: 1)
Rci__nightly-cyclonedds_ubuntu_noble_amd64#157	ros2service.ros2service.test.test_cli.test_cli (age: 1)
Rci__nightly-connext_ubuntu_noble_amd64#160	10 errors rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset (age: 160)
Rci__benchmark_ubuntu_noble_amd64#111	projectroot.benchmark_string_conversions (age: 111)
Jci__nightly-performance_ubuntu_noble_amd64#40	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 1)
Jci__nightly-debug_ubuntu_noble_amd64#55	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp (age: 1)
Jci__nightly-connext_ubuntu_noble_amd64#59	13 errors rclpy.rclpy.test.test_client.TestClient.test_service_timestamps (age: 1)
Jci__benchmark_ubuntu_noble_amd64#39	projectroot.benchmark_string_conversions (age: 39)
Ici__nightly-performance_ubuntu_jammy_amd64#131	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 3)
Ici__nightly-cyclonedds_ubuntu_jammy_amd64#168	ros2topic.ros2topic.test.test_cli.test_cli (age: 1)
Ici__nightly-connext_ubuntu_jammy_amd64#172	11 errors launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 73)
Hci__nightly-performance_ubuntu_jammy_amd64#269	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 1)
Hci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#281	ros2lifecycle.ros2lifecycle.test.test_cli.test_cli (age: 1)
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#286	18 errors test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/tmp/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] (age: 1)
Hci__nightly-connext_ubuntu_jammy_amd64#278	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 9)

Test regressions known

Ros

Open issues

Issue	Jobs Name	Errors Name
https://github.com/ros2/demos/issues/693	nightly_win_rep nightly_win_deb nightly_linux-rhel_repeated	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output projectroot.test_tutorial_parameter_events_async__rmw_connextdds projectroot.test_tutorial_parameter_events__rmw_connextdds
https://github.com/ros2/rosidl/issues/812	nightly_linux_coverage	projectroot.test_multi_nested_message_introspection rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
https://github.com/ros2/rcl/issues/1162	nightly_win_deb	projectroot.test_action_interaction__rmw_connextdds rcl_action.TestActionClientServerInteraction.test_interaction rcl_action.TestActionClientServerInteraction.test_interaction_with_cancel
https://github.com/ros2/rclcpp/issues/2582	Jci__nightly-connext_ubuntu_noble_amd64 Rci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_service rclcpp.TestService.server_qos projectroot.test.rclcpp.test_client_common rclcpp.TestAllClientTypesWithServer/Client.client_qos rclcpp.TestAllClientTypesWithServer/GenericClient.client_qos
https://github.com/ros2/rmw_connextdds/issues/155	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	11 errors projectroot.test.rclcpp.test_client rclcpp.TestClient.on_new_response_callback projectroot.test.rclcpp.test_qos_event rclcpp.TestQosEvent.test_on_new_event_callback rclcpp.TestQosEvent.test_invalid_on_new_event_callback projectroot.test.rclcpp.test_service rclcpp.TestService.on_new_request_callback projectroot.test.rclcpp.test_subscription rclcpp.TestSubscription.on_new_message_callback projectroot.test.rclcpp.test_executors rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
https://github.com/ros2/rclcpp/issues/2588	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
https://github.com/ros2/rosidl_typesupport_fastrtps/issues/119	Rci__benchmark_ubuntu_noble_amd64 Jci__benchmark_ubuntu_noble_amd64	projectroot.benchmark_string_conversions
https://github.com/ros2/launch_ros/issues/408	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
https://github.com/ros2/rclcpp/issues/2611	Ici__nightly-connext_ubuntu_jammy_amd64	rclcpp.TestClient.client_qos
https://github.com/ros2/examples/issues/391	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
https://github.com/ros2/rclpy/issues/1347	Hci__nightly-connext_ubuntu_jammy_amd64	projectroot.test_client rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
https://github.com/ros2/rclcpp/issues/2613	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
https://github.com/ros2/launch/issues/796	nightly_linux_coverage	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Gazebo

Open issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-rendering/issues/745	gz_rendering-7-win gz_rendering-8-win gz_rendering-9-win	71 errors CameraTest.ViewProjectionMatrix CameraTest.RenderTexture CameraTest.TrackFollow CameraTest.AddRemoveRenderPass CameraTest.VisibilityMask CameraTest.IntrinsicMatrix GpuRaysTest.Configure LidarVisualTest.Configure LidarVisualTest.LidarVisual ProjectorTest.Projector SceneTest.Scene SceneTest.SceneGradient SceneTest.Nodes SceneTest.RemoveNodes SceneTest.DestroyNodes SceneTest.NodeCycle SceneTest.Materials SceneTest.Time SceneTest.BackgroundMaterial ThermalCameraTest.ThermalCamera ReloadEngineTest.Scene ArrowVisualTest.ArrowVisual AxisVisualTest.AxisVisual COMVisualTest.COMVisual CapsuleTest.Capsule GizmoVisualTest.GizmoVisual GizmoVisualTest.Material GridTest.Grid InertiaVisualTest.InertiaVisual LightVisualTest.LightVisual LightTest.Light MarkerTest.Marker MaterialTest.MaterialProperties MeshDescriptorTest.Descriptor MeshTest.MeshSubMesh MeshTest.MeshSkeleton MeshTest.MeshSkeletonAnimation MeshTest.MeshClone MoveToHelperTest.MoveTo NodeTest.Pose OrbitViewControllerTest.OrbitViewControl OrbitViewControllerTest.Constructor OrbitViewControllerTest.Control OrthoViewControllerTest.OrthoViewControl OrthoViewControllerTest.Control ParticleEmitterTest.ParticleEmitter RayQueryTest.RayQuery RenderTargetTest.RenderTexture RenderTargetTest.RenderWindow RenderTargetTest.AddRemoveRenderPass RenderingIfaceTest.GetEngine TextTest.Text TransformControllerTest.TransformControl TransformControllerTest.WorldSpace TransformControllerTest.LocalSpace TransformControllerTest.Control2d VisualTest.Material VisualTest.Children VisualTest.Scale VisualTest.UserData VisualTest.Geometry VisualTest.VisibilityFlags VisualTest.BoundingBox VisualTest.Wireframe VisualTest.Clone WavesTest.Waves MeshTest.NormalMapWithoutTexCoord GizmoVisualTest.LookAt FontTestInstantiation/FontTest.SupportedFont/0 FontTestInstantiation/FontTest.SupportedFont/1 FontTestInstantiation/FontTest.SupportedFont/2
https://github.com/gazebosim/gz-transport/issues/509	gz_transport-ci-gz-transport12-homebrew-amd64	UNIT_gz_TEST.xml.[failed-to-read]
https://github.com/gazebosim/gz-transport/issues/510	gz_transport-ci-ign-transport11-homebrew-amd64	ignTest.TopicInfo

Disabled issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-transport/issues/195	gz_transport-ign-transport8-win gz_transport-ign-transport11-win gz_transport-12-win gz_transport-13-win	playback.ReplayStep
https://github.com/gazebosim/gz-rendering/issues/847	gz_rendering-ci-ign-rendering3-homebrew-amd64 gz_rendering-ci-ign-rendering6-homebrew-amd64	34 errors UNIT_Visual_TEST.test_ran UNIT_TransformController_TEST.test_ran UNIT_ThermalCamera_TEST.test_ran UNIT_Scene_TEST.test_ran UNIT_RenderingIface_TEST.test_ran UNIT_RenderTarget_TEST.test_ran UNIT_RayQuery_TEST.test_ran UNIT_OrbitViewController_TEST.test_ran UNIT_Node_TEST.test_ran UNIT_MoveToHelper_TEST.test_ran UNIT_Mesh_TEST.test_ran UNIT_Material_TEST.test_ran UNIT_Marker_TEST.test_ran UNIT_Light_TEST.test_ran UNIT_Grid_TEST.test_ran UNIT_Camera_TEST.test_ran UNIT_AxisVisual_TEST.test_ran UNIT_ArrowVisual_TEST.test_ran INTEGRATION_shadows.test_ran INTEGRATION_scene.test_ran INTEGRATION_render_pass.test_ran INTEGRATION_depth_camera.test_ran INTEGRATION_camera.test_ran INTEGRATION_thermal_camera.test_ran INTEGRATION_gpu_rays.test_ran INTEGRATION_lidar_visual.test_ran UNIT_Capsule_TEST.test_ran UNIT_Heightmap_TEST.test_ran UNIT_JointVisual_TEST.test_ran UNIT_LidarVisual_TEST.test_ran UNIT_LightVisual_TEST.test_ran UNIT_OrthoViewController_TEST.test_ran UNIT_Text_TEST.test_ran UNIT_WireBox_TEST.test_ran
https://github.com/gazebosim/gz-sim/issues/1887	gz_sim-ci-ign-gazebo6-homebrew-amd64	.gz-sim.python.test.testFixture_TEST

[github-actions]

Oct 03

Urgent

Build regressions

Reference Build	Failure DateTime	Failure Reason
nightly_linux_iron_coverage#589	2024-10-03 07:31	Number of failed test exceeds the threshold
packaging_windows_debug#2351	2024-10-03 06:05	Packages rviz_ogre_vendor Failed

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Rci__nightly-connext_ubuntu_noble_amd64#163	22	2024-10-03 06:26:39.051000	projectroot.test.rclcpp.test_generic_service rclcpp.TestGenericService.generic_service_qos	No reports found!
nightly_win_rep#3498	5	2024-10-03 04:00:01.584000	projectroot.gtest_multithreaded__rmw_connextdds	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#163	3	2024-10-03 06:26:39.051000	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!

Test regressions flaky

Test regressions

Reference builds	Errors	Flaky report	Reports
nightly_win_rep#3498	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Jci__nightly-connext_ubuntu_noble_amd64 2024-09-29 2024-09-20 4 4 100.0% Rci__nightly-connext_ubuntu_noble_amd64 2024-10-03 2024-09-18 15 12 80.0% nightly_win_rep 2024-10-03 2024-10-03 11 1 9.09% nightly_win_deb 2024-09-18 2024-09-18 14 1 7.14%	No reports found!
nightly_win_deb#3235	projectroot.gtest_multithreaded__rmw_connextdds	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-18 11 11 100.0% nightly_win_deb 2024-10-03 2024-09-18 14 7 50.0% nightly_win_rel 2024-09-28 2024-09-28 14 1 7.14%	No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#269	projectroot.test.test_performance_CycloneDDS_sync_Array8m	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 3 3 100.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Hci__nightly-performance_ubuntu_jammy_amd64 2024-10-01 2024-10-01 5 1 20.0% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-27 2024-09-27 13 1 7.69%	No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#269	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Ici__nightly-performance_ubuntu_jammy_amd64 2024-09-29 2024-09-20 3 3 100.0% Jci__nightly-performance_ubuntu_noble_amd64 2024-09-30 2024-09-30 2 1 50.0% Rci__nightly-performance_ubuntu_noble_amd64 2024-09-28 2024-09-25 13 3 23.08% Hci__nightly-performance_ubuntu_jammy_amd64 2024-10-01 2024-10-01 5 1 20.0%	No reports found!
nightly_win_deb#3235	test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-02 2024-09-19 11 8 72.73% nightly_win_deb 2024-10-03 2024-09-18 14 5 35.71% nightly_win_rel 2024-09-28 2024-09-28 14 1 7.14%	No reports found!
nightly_win_rep#3498 nightly_linux_repeated#3600	projectroot.test.rclcpp.test_clock rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock projectroot.test.rclcpp.test_clock rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-19 11 7 63.64% nightly_linux_repeated 2024-10-03 2024-09-19 13 4 30.77%	No reports found!
nightly_win_rep#3498	test_rclcpp.test_timeout_subscriber.timeout_subscriber	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-18 11 7 63.64%	No reports found!
nightly_win_rep#3498	projectroot.gtest_multiple_service_calls__rmw_connextdds test_rclcpp.gtest_multiple_service_calls__rmw_connextdds.gtest.missing_result	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-18 11 6 54.55%	No reports found!
nightly_linux_humble_coverage#953	launch_testing_ros.test.examples.wait_for_topic_launch_test.wait_for_topic_launch_test	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_linux_humble_coverage 2024-10-03 2024-09-19 13 6 46.15% nightly_linux_iron_coverage 2024-10-02 2024-09-22 11 3 27.27% nightly_linux-rhel_repeated 2024-09-24 2024-09-23 15 2 13.33%	https://github.com/ros2/launch_ros/issues/304 (Closed)
nightly_win_rep#3498	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-18 11 5 45.45% nightly_linux_coverage 2024-10-02 2024-09-23 12 2 16.67% nightly_linux_iron_coverage 2024-09-27 2024-09-27 11 1 9.09%	No reports found!
nightly_win_rep#3498	projectroot.test_server	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-20 11 4 36.36%	No reports found!
nightly_win_rep#3498	projectroot.test.rclcpp.test_executors_busy_waiting	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-21 11 4 36.36% nightly_win_deb 2024-09-18 2024-09-18 14 1 7.14% nightly_linux-rhel_repeated 2024-09-22 2024-09-22 15 1 6.67%	No reports found!
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#287	projectroot.test_cli_remapping	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-09-27 2024-09-18 11 4 36.36% Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-10-03 2024-09-30 6 2 33.33% nightly_linux-aarch64_repeated 2024-09-21 2024-09-18 16 2 12.5% nightly_linux-rhel_repeated 2024-10-02 2024-10-02 15 1 6.67%	No reports found!
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#287	launch_testing_examples.launch_testing_examples.check_multiple_nodes_launch_test.launch_testing_examples.check_multiple_nodes_launch_test	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage Hci__nightly-cyclonedds_ubuntu_jammy_amd64 2024-10-03 2024-09-30 6 2 33.33% nightly_linux-aarch64_repeated 2024-09-29 2024-09-21 16 3 18.75% nightly_linux-rhel_repeated 2024-09-27 2024-09-20 15 2 13.33% nightly_linux_repeated 2024-09-23 2024-09-23 13 1 7.69%	https://github.com/ros2/examples/issues/340 (Closed)
nightly_win_rep#3498	projectroot.gtest_timeout_subscriber__rmw_cyclonedds_cpp	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-21 11 3 27.27%	No reports found!
nightly_win_rep#3498	projectroot.test.rclcpp.test_executor rclcpp.test_executor.gtest.missing_result	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-23 11 3 27.27% nightly_win_deb 2024-09-27 2024-09-18 14 2 14.29%	https://github.com/ros2/rclcpp/issues/2502 (Closed) https://github.com/ros2/rmw_connextdds/issues/155 (Open)
nightly_win_rep#3498	test_rclcpp.test_multithreaded.multi_access_publisher	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_win_rep 2024-10-03 2024-09-18 11 3 27.27% nightly_win_deb 2024-09-23 2024-09-21 14 2 14.29%	No reports found!
nightly_linux_repeated#3600 nightly_linux-aarch64_repeated#2903	projectroot.test_record__rmw_fastrtps_cpp rosbag2_transport.RecordIntegrationTestFixture.can_record_again_after_stop projectroot.test_record__rmw_fastrtps_cpp rosbag2_transport.RecordIntegrationTestFixture.can_record_again_after_stop	Job Name Last Fail First Fail Build Count Failure Count Failure Percentage nightly_linux-aarch64_repeated 2024-10-03 2024-09-18 16 3 18.75% nightly_linux_repeated 2024-10-03 2024-10-03 13 1 7.69% nightly_linux-aarch64_release 2024-09-20 2024-09-20 15 1 6.67%	No reports found!

Maintenance

Jobs last success date

Job Name	Last Success
Hci__nightly-connext_ubuntu_jammy_amd64	Never
Ici__nightly-connext_ubuntu_jammy_amd64	Never
Rci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-8-win	Never
gz_rendering-7-win	Never
Jci__nightly-connext_ubuntu_noble_amd64	Never
Jci__benchmark_ubuntu_noble_amd64	Never
gz_rendering-9-win	Never
nightly_win_rep	2024-01-12
Rci__nightly-connext_ubuntu_noble_amd64	2024-05-04
nightly_linux_coverage	2024-05-24
nightly_win_deb	2024-06-03
gz_rendering-ign-rendering6-win	2024-07-02
gz_rendering-ign-rendering3-win	2024-07-07
gz_transport-ci-ign-transport11-homebrew-amd64	2024-07-08
nightly_linux_repeated	2024-08-14
Ici__nightly-performance_ubuntu_jammy_amd64	2024-09-17
nightly_linux-rhel_repeated	2024-09-17

Pending

Test regressions all

Reference Build	Error Name
nightly_win_rep#3498	370 errors test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully (age: 1)
nightly_win_rel#3188	image_tools.TestExecutablesDemo.test_reliable_qos (age: 1)
nightly_win_deb#3235	118 errors test_communication.TestRequesterReplierAfterShutdown.test_processes_finished_gracefully[Empty] (age: 1)
nightly_linux_repeated#3600	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock (age: 2)
nightly_linux_humble_coverage#953	launch_testing_ros.test.examples.wait_for_topic_launch_test.wait_for_topic_launch_test (age: 1)
nightly_linux_coverage#2541	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage (age: 136)
nightly_linux-rhel_repeated#2048	projectroot.test_record__rmw_cyclonedds_cpp (age: 1)
nightly_linux-aarch64_repeated#2903	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 1)
gz_transport-ci-ign-transport11-homebrew-amd64#81	ignTest.TopicInfo (age: 24)
gz_sensors-ci-gz-sensors8-homebrew-amd64#85	DopplerVelocityLogTests/DopplerVelocityLogTest.BottomTrackingWhileInMotion/ogre (age: 1)
gz_rendering-9-win#18	71 errors VisualTest.Clone (age: 18)
gz_rendering-7-win#82	67 errors VisualTest.Clone (age: 21)
gz_common-ci-gz-common5-noble-amd64#49	TempDirectory.createTempDirectoryEmptyBase (age: 1)
Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#154	ros2service.ros2service.test.test_cli.test_cli (age: 1)
Rci__nightly-cyclonedds_ubuntu_noble_amd64#159	rclpy.rclpy.test.test_node.TestNodeAllowUndeclaredParameters.test_node_has_parameter_services (age: 1)
Rci__nightly-connext_ubuntu_noble_amd64#163	13 errors rclcpp.TestGenericService.generic_service_qos (age: 22)
Rci__benchmark_ubuntu_noble_amd64#112	projectroot.benchmark_string_conversions (age: 112)
Jci__benchmark_ubuntu_noble_amd64#40	projectroot.benchmark_string_conversions (age: 40)
Ici__nightly-cyclonedds_ubuntu_jammy_amd64#168	ros2topic.ros2topic.test.test_cli.test_cli (age: 1)
Ici__nightly-connext_ubuntu_jammy_amd64#172	11 errors launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 73)
Hci__nightly-performance_ubuntu_jammy_amd64#269	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS (age: 1)
Hci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#281	ros2lifecycle.ros2lifecycle.test.test_cli.test_cli (age: 1)
Hci__nightly-cyclonedds_ubuntu_jammy_amd64#287	28 errors test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/tmp/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] (age: 2)
Hci__nightly-connext_ubuntu_jammy_amd64#279	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (age: 10)

Test regressions known

Ros

Open issues

Issue	Jobs Name	Errors Name
https://github.com/ros2/demos/issues/693	nightly_win_rep nightly_win_deb nightly_linux-rhel_repeated	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output projectroot.test_tutorial_parameter_events_async__rmw_connextdds projectroot.test_tutorial_parameter_events__rmw_connextdds
https://github.com/ros2/rosidl/issues/812	nightly_linux_coverage	projectroot.test_multi_nested_message_introspection rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
https://github.com/ros2/rcl/issues/1162	nightly_win_deb	projectroot.test_action_interaction__rmw_connextdds rcl_action.TestActionClientServerInteraction.test_interaction rcl_action.TestActionClientServerInteraction.test_interaction_with_cancel
https://github.com/ros2/rclcpp/issues/2582	Jci__nightly-connext_ubuntu_noble_amd64 Rci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_service rclcpp.TestService.server_qos projectroot.test.rclcpp.test_client_common rclcpp.TestAllClientTypesWithServer/Client.client_qos rclcpp.TestAllClientTypesWithServer/GenericClient.client_qos
https://github.com/ros2/rmw_connextdds/issues/155	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	11 errors projectroot.test.rclcpp.test_client rclcpp.TestClient.on_new_response_callback projectroot.test.rclcpp.test_qos_event rclcpp.TestQosEvent.test_on_new_event_callback rclcpp.TestQosEvent.test_invalid_on_new_event_callback projectroot.test.rclcpp.test_service rclcpp.TestService.on_new_request_callback projectroot.test.rclcpp.test_subscription rclcpp.TestSubscription.on_new_message_callback projectroot.test.rclcpp.test_executors rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
https://github.com/ros2/rclcpp/issues/2588	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
https://github.com/ros2/rosidl_typesupport_fastrtps/issues/119	Rci__benchmark_ubuntu_noble_amd64 Jci__benchmark_ubuntu_noble_amd64	projectroot.benchmark_string_conversions
https://github.com/ros2/launch_ros/issues/408	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
https://github.com/ros2/rclcpp/issues/2611	Ici__nightly-connext_ubuntu_jammy_amd64	rclcpp.TestClient.client_qos
https://github.com/ros2/examples/issues/391	Hci__nightly-connext_ubuntu_jammy_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
https://github.com/ros2/rclcpp/issues/2613	Rci__nightly-connext_ubuntu_noble_amd64 Jci__nightly-connext_ubuntu_noble_amd64 Ici__nightly-connext_ubuntu_jammy_amd64	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
https://github.com/ros2/launch/issues/796	nightly_linux_coverage	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Gazebo

Open issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-rendering/issues/745	gz_rendering-7-win gz_rendering-8-win gz_rendering-9-win	71 errors CameraTest.ViewProjectionMatrix CameraTest.RenderTexture CameraTest.TrackFollow CameraTest.AddRemoveRenderPass CameraTest.VisibilityMask CameraTest.IntrinsicMatrix GpuRaysTest.Configure LidarVisualTest.Configure LidarVisualTest.LidarVisual ProjectorTest.Projector SceneTest.Scene SceneTest.SceneGradient SceneTest.Nodes SceneTest.RemoveNodes SceneTest.DestroyNodes SceneTest.NodeCycle SceneTest.Materials SceneTest.Time SceneTest.BackgroundMaterial ThermalCameraTest.ThermalCamera ReloadEngineTest.Scene ArrowVisualTest.ArrowVisual AxisVisualTest.AxisVisual COMVisualTest.COMVisual CapsuleTest.Capsule GizmoVisualTest.GizmoVisual GizmoVisualTest.Material GridTest.Grid InertiaVisualTest.InertiaVisual LightVisualTest.LightVisual LightTest.Light MarkerTest.Marker MaterialTest.MaterialProperties MeshDescriptorTest.Descriptor MeshTest.MeshSubMesh MeshTest.MeshSkeleton MeshTest.MeshSkeletonAnimation MeshTest.MeshClone MoveToHelperTest.MoveTo NodeTest.Pose OrbitViewControllerTest.OrbitViewControl OrbitViewControllerTest.Constructor OrbitViewControllerTest.Control OrthoViewControllerTest.OrthoViewControl OrthoViewControllerTest.Control ParticleEmitterTest.ParticleEmitter RayQueryTest.RayQuery RenderTargetTest.RenderTexture RenderTargetTest.RenderWindow RenderTargetTest.AddRemoveRenderPass RenderingIfaceTest.GetEngine TextTest.Text TransformControllerTest.TransformControl TransformControllerTest.WorldSpace TransformControllerTest.LocalSpace TransformControllerTest.Control2d VisualTest.Material VisualTest.Children VisualTest.Scale VisualTest.UserData VisualTest.Geometry VisualTest.VisibilityFlags VisualTest.BoundingBox VisualTest.Wireframe VisualTest.Clone WavesTest.Waves MeshTest.NormalMapWithoutTexCoord GizmoVisualTest.LookAt FontTestInstantiation/FontTest.SupportedFont/0 FontTestInstantiation/FontTest.SupportedFont/1 FontTestInstantiation/FontTest.SupportedFont/2
https://github.com/gazebosim/gz-transport/issues/509	gz_transport-ci-gz-transport12-homebrew-amd64	UNIT_gz_TEST.xml.[failed-to-read]
https://github.com/gazebosim/gz-transport/issues/510	gz_transport-ci-ign-transport11-homebrew-amd64	ignTest.TopicInfo

Disabled issues

Issue	Jobs Name	Errors Name
https://github.com/gazebosim/gz-transport/issues/195	gz_transport-ign-transport8-win gz_transport-ign-transport11-win gz_transport-12-win gz_transport-13-win	playback.ReplayStep
https://github.com/gazebosim/gz-rendering/issues/847	gz_rendering-ci-ign-rendering3-homebrew-amd64 gz_rendering-ci-ign-rendering6-homebrew-amd64	34 errors UNIT_Visual_TEST.test_ran UNIT_TransformController_TEST.test_ran UNIT_ThermalCamera_TEST.test_ran UNIT_Scene_TEST.test_ran UNIT_RenderingIface_TEST.test_ran UNIT_RenderTarget_TEST.test_ran UNIT_RayQuery_TEST.test_ran UNIT_OrbitViewController_TEST.test_ran UNIT_Node_TEST.test_ran UNIT_MoveToHelper_TEST.test_ran UNIT_Mesh_TEST.test_ran UNIT_Material_TEST.test_ran UNIT_Marker_TEST.test_ran UNIT_Light_TEST.test_ran UNIT_Grid_TEST.test_ran UNIT_Camera_TEST.test_ran UNIT_AxisVisual_TEST.test_ran UNIT_ArrowVisual_TEST.test_ran INTEGRATION_shadows.test_ran INTEGRATION_scene.test_ran INTEGRATION_render_pass.test_ran INTEGRATION_depth_camera.test_ran INTEGRATION_camera.test_ran INTEGRATION_thermal_camera.test_ran INTEGRATION_gpu_rays.test_ran INTEGRATION_lidar_visual.test_ran UNIT_Capsule_TEST.test_ran UNIT_Heightmap_TEST.test_ran UNIT_JointVisual_TEST.test_ran UNIT_LidarVisual_TEST.test_ran UNIT_LightVisual_TEST.test_ran UNIT_OrthoViewController_TEST.test_ran UNIT_Text_TEST.test_ran UNIT_WireBox_TEST.test_ran
https://github.com/gazebosim/gz-sim/issues/1887	gz_sim-ci-ign-gazebo6-homebrew-amd64	.gz-sim.python.test.testFixture_TEST

[claraberendsen]

2024-10-03 Gazebo test regressions

Since there is no new consistent test regressions, taking a look at the maintenance and pending column.

Maintenance

All issues are consistent yellows and have been reported to the team before

• 🧑‍🌾 SEH Exceptions in gz-rendering-win gazebosim/gz-rendering#745
• 🧑‍🌾 Warnings in rendering windows 3 and 6 gazebosim/gz-rendering#993
• 🧑‍🌾 Gz-transport11-homebrew UNIT_gz_TEST ignTest.TopicInfo failed gazebosim/gz-transport#510

Pending

• gz_common-ci-gz-common5-noble-amd64#49
  First appearance, running the job a couple of times to see if it's a consistent regression. It seems to be a transient error runs 50 and 51 came back green.
• gz_sensors-ci-gz-sensors8-homebrew-amd64#85.
  First appearance, re-running it a couple of times to check consistency.