Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Buildfarmer log 2024/06/17 - 2024/06/24 #58

Closed
github-actions bot opened this issue Jun 17, 2024 · 11 comments
Closed

Buildfarmer log 2024/06/17 - 2024/06/24 #58

github-actions bot opened this issue Jun 17, 2024 · 11 comments
Labels
buildfarmer-log Log of issues in the buildfarm

Comments

@github-actions
Copy link
Contributor

Previous log #56

@github-actions github-actions bot added the buildfarmer-log Log of issues in the buildfarm label Jun 17, 2024
Copy link
Contributor Author

Jun 17

Build regressions
packaging_linux|3475|2024-06-17 07:59:42.197000|Packages rviz_default_plugins  Failed|build underlay packages
packaging_linux-rhel|1972|2024-06-17 08:17:09.586000|Packages rviz_default_plugins  Failed|build underlay packages
Ici__nightly-release_ubuntu_jammy_amd64|134|2024-06-16 22:44:46.182000|Number of failed test exceeds the threshold|run tests
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 100.0% in 15 out of 15 builds
	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
	projectroot.test_multi_nested_message_introspection
	  (also in: "nightly_win_rep" job)

Issue #2 in nightly_win_rep
- Failing 100.0% in 13 out of 13 builds
	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)

Issue #3 in nightly_win_deb
- Failing 56.25% in 9 out of 16 builds
	sros2.test.sros2.commands.security.verbs.test_generate_policy_no_nodes.test_generate_policy_no_nodes
	  (also in: "nightly_win_rel" job)

Issue #4 in nightly_linux_repeated
- Failing 43.75% in 7 out of 16 builds
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock
	projectroot.test.rclcpp.test_clock
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #5 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	projectroot.test_lifecycle_service_client (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)

Issue #6 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #7 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
	  (also in: "nightly_win_rep" job)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #8 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_double_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclcpp_lifecycle.TestLifecycleServiceClientRCLErrors.call_services_rcl_errors (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all
	projectroot.test_guard_condition (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #9 in gz_rendering-ci-main-noble-amd64
- Failing 100.0% in 5 out of 5 builds
	INTEGRATION_load_unload_ogre_gl3plus.test_ran

Issue #10 in gz_sensors-ci-main-noble-amd64
- Failing 100.0% in 5 out of 5 builds
	BoundingBoxCameraSensor/BoundingBoxCameraSensorTest.BoxesWithBuiltinSDF/ogre2
	<init>.BoundingBoxCameraSensor/BoundingBoxCameraSensorTest

Issue #11 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #12 in nightly_win_rep
- Failing 30.77% in 4 out of 13 builds
	test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe]

Issue #13 in nightly_win_rep
- Failing 30.77% in 4 out of 13 builds
	rclpy.test_subscription.xunit.missing_result
	  (also in: "nightly_win_rel" job)

Issue #14 in nightly_win_rep
- Failing 30.77% in 4 out of 13 builds
	projectroot.test_subscription
	  (also in: "nightly_win_rel" job)
	  (also in: "Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #15 in gz_rendering-7-win
- Failing 100.0% in 3 out of 3 builds
	MeshTest.NormalMapWithoutTexCoord
	  (also in: "gz_rendering-main-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-7-win" job)

Issue #16 in nightly_linux-rhel_repeated
- Failing 18.75% in 3 out of 16 builds
	projectroot.test_tf2_geometry_msgs

Issue #17 in nightly_linux_repeated
- Failing 18.75% in 3 out of 16 builds
	test_rclcpp.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp.xunit.missing_result
	projectroot.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp

Issue #18 in nightly_win_rep
- Failing 23.08% in 3 out of 13 builds
	rclcpp.TestBusyWaiting/EventsExecutor.test_spin

Issue #19 in nightly_win_rep
- Failing 23.08% in 3 out of 13 builds
	rclpy.test_waitable.xunit.missing_result
	projectroot.test_waitable
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #20 in nightly_win_rep
- Failing 23.08% in 3 out of 13 builds
	projectroot.test_timer
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux_iron_coverage" job)

Issue #21 in nightly_win_rep
- Failing 23.08% in 3 out of 13 builds
	rclpy.test_wait_for_message.xunit.missing_result
	rclpy.test_timer.xunit.missing_result
	rclpy.test_time_source.xunit.missing_result
	projectroot.test_wait_for_message
	projectroot.test_time_source
	  (also in: "nightly_win_rel" job)

Issue #22 in nightly_linux-aarch64_repeated
- Failing 20.0% in 3 out of 15 builds
	projectroot.test_cli_remapping
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #23 in Jci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	projectroot.benchmark_string_conversions
	  (also in: "Rci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)

Issue #24 in gz_sim-7-win
- Failing 40.0% in 2 out of 5 builds
	INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-7-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)

Issue #25 in nightly_linux-aarch64_repeated
- Failing 13.33% in 2 out of 15 builds
	rosbag2_transport.RecordIntegrationTestFixture.can_record_again_after_stop
	projectroot.test_record__rmw_fastrtps_cpp
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #26 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	projectroot.display_factory_test

Issue #27 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)

Issue #28 in nightly_win_rep
- Failing 15.38% in 2 out of 13 builds
	test_cli_remapping.TestCLIRemapping.test_topic_and_service_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe]

Issue #29 in nightly_win_rep
- Failing 15.38% in 2 out of 13 builds
	projectroot.test_default_state_machine

Issue #30 in gz_sensors-ci-ign-sensors6-homebrew-amd64
- Failing 25.0% in 1 out of 4 builds
	CameraSensor/TriggeredCameraTest.ImagesWithBuiltinSDF/ogre

Issue #31 in gz_sim-ign-gazebo6-win
- Failing 25.0% in 1 out of 4 builds
	INTEGRATION_multiple_servers.test_ran
	  (also in: "gz_sim-main-win" job)
	  (also in: "gz_sim-8-win" job)

Issue #32 in gz_sim-main-win
- Failing 20.0% in 1 out of 5 builds
	ServerRepeat/MultipleServers.TwoServersMixedBlocking/0

Issue #33 in gz_transport-ci-gz-transport13-homebrew-amd64
- Failing 20.0% in 1 out of 5 builds
	gzTest.TopicEchoNum

Issue #34 in gz_transport-12-win
- Failing 25.0% in 1 out of 4 builds
	playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport8-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport11-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)

Issue #35 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/home/jenkins-agent/workspace/nightly_linux-aarch64_repeated/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]

Issue #36 in nightly_linux-rhel_debug
- Failing 6.25% in 1 out of 16 builds
	launch_testing_examples.launch_testing_examples.hello_world_launch_test.launch_testing_examples.hello_world_launch_test
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-aarch64_release" job)

Issue #37 in nightly_linux_debug
- Failing 6.25% in 1 out of 16 builds
	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_release" job)

Issue #38 in nightly_linux_debug
- Failing 6.25% in 1 out of 16 builds
	test_security.TestSecurePublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_1
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_0
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_release" job)

Issue #39 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	ros2doctor.ros2doctor.test.test_qos_compatibility.test_qos_compatibility
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #40 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)

Issue #41 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	launch_testing_examples.launch_testing_examples.check_multiple_nodes_launch_test.launch_testing_examples.check_multiple_nodes_launch_test (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)

Issue #42 in nightly_win_rep
- Failing 7.69% in 1 out of 13 builds
	rcl_lifecycle.TestDefaultStateMachine.zero_init

@Crola1702
Copy link
Contributor

Ros2 nightlies | Build regressions | Investigating 🕵️

No space left on the device (agent linux-c0ba4338):

Reference builds:

Keeping track

Build time outs (both on ci_agent-d386d541)

Reference builds:

None of there were hung at the end

Copy link
Contributor Author

Jun 18

Build regressions
nightly_linux-aarch64_debug|2801|2024-06-18 04:00:00.944000|Jenkins channel closing down (Agent disconnected)|build
Rci__nightly-connext_ubuntu_noble_amd64|62|2024-06-17 14:14:53.009000|Number of failed test exceeds the threshold|run tests
gz_transport-main-win|54|2024-06-18 01:06:19.837000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
gz_msgs-9-win|51|2024-06-17 23:06:35.371000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 100.0% in 15 out of 15 builds
	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
	projectroot.test_multi_nested_message_introspection
	  (also in: "nightly_win_rep" job)

Issue #2 in nightly_win_deb
- Failing 60.0% in 9 out of 15 builds
	sros2.test.sros2.commands.security.verbs.test_generate_policy_no_nodes.test_generate_policy_no_nodes
	  (also in: "nightly_win_rel" job)

Issue #3 in nightly_linux_repeated
- Failing 40.0% in 6 out of 15 builds
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock
	projectroot.test.rclcpp.test_clock
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #4 in nightly_linux-rhel_debug
- Failing 37.5% in 6 out of 16 builds
	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)

Issue #5 in gz_rendering-ci-main-noble-amd64
- Failing 100.0% in 5 out of 5 builds
	INTEGRATION_load_unload_ogre_gl3plus.test_ran

Issue #6 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test_lifecycle_service_client (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)

Issue #7 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #8 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #9 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
	  (also in: "nightly_win_rep" job)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #10 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_double_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclcpp_lifecycle.TestLifecycleServiceClientRCLErrors.call_services_rcl_errors (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all
	projectroot.test_guard_condition (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #11 in gz_rendering-7-win
- Failing 100.0% in 4 out of 4 builds
	MeshTest.NormalMapWithoutTexCoord
	  (also in: "gz_rendering-main-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-7-win" job)

Issue #12 in gz_sensors-ci-main-noble-amd64
- Failing 100.0% in 4 out of 4 builds
	BoundingBoxCameraSensor/BoundingBoxCameraSensorTest.BoxesWithBuiltinSDF/ogre2
	<init>.BoundingBoxCameraSensor/BoundingBoxCameraSensorTest

Issue #13 in nightly_linux_iron_coverage
- Failing 25.0% in 4 out of 16 builds
	test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all

Issue #14 in nightly_linux_iron_coverage
- Failing 25.0% in 4 out of 16 builds
	projectroot.test_timer
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_rel" job)

Issue #15 in nightly_linux_repeated
- Failing 26.67% in 4 out of 15 builds
	launch_testing_examples.launch_testing_examples.check_multiple_nodes_launch_test.launch_testing_examples.check_multiple_nodes_launch_test (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/examples/issues/340 - CLOSED)

Issue #16 in nightly_linux_repeated
- Failing 20.0% in 3 out of 15 builds
	test_rclcpp.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp.xunit.missing_result
	projectroot.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp

Issue #17 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code

Issue #18 in Jci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	projectroot.benchmark_string_conversions
	  (also in: "Rci__benchmark_ubuntu_noble_amd64" job)
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)

Issue #19 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/home/jenkins-agent/workspace/nightly_linux-rhel_repeated/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]

Issue #20 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_cli_remapping
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #21 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test_tutorial_talker_listener__rmw_fastrtps_cpp

Issue #22 in gz_sensors-ci-ign-sensors6-homebrew-amd64
- Failing 25.0% in 1 out of 4 builds
	CameraSensor/TriggeredCameraTest.ImagesWithBuiltinSDF/ogre

Issue #23 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	rosbag2_py.test_transport_py.xunit.missing_result
	projectroot.test_transport_py
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #24 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[3-3]

Issue #25 in nightly_linux_repeated
- Failing 6.67% in 1 out of 15 builds
	ros2doctor.ros2doctor.test.test_qos_compatibility.test_qos_compatibility
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #26 in nightly_linux_repeated
- Failing 6.67% in 1 out of 15 builds
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux_coverage" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)

@Crola1702
Copy link
Contributor

Crola1702 commented Jun 18, 2024

Windows debug | Flaky test regression | Investigating 🕵️

Reference build:

Test regression:

Log output:
test_generate_policy_no_nodes.TestSROS2GeneratePolicyVerbWithNoNodes.test_generate_policy_no_nodes[rmw_fastrtps_cpp, True] failed
test_generate_policy_no_nodes.TestSROS2GeneratePolicyVerbWithNoNodes.test_generate_policy_no_policy_file[rmw_fastrtps_cpp, True] failed

...

FAIL: test_generate_policy_no_nodes.TestSROS2GeneratePolicyVerbWithNoNodes.test_generate_policy_no_policy_file[rmw_fastrtps_cpp, True]
-----------------------------------------------------------
Exception: Launch stopped before the active tests finished.
---------------------------- Captured stdout call -----------------------------

Starting test run test_generate_policy_no_nodes[rmw_fastrtps_cpp, True]
[INFO] [launch]: All log files can be found below C:\Users\ContainerAdministrator\.ros\log\2024-06-17-08-00-12-989365-72b9d2b249b9-8684
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [daemon-stop-29]: process started with pid [8124]
[INFO] [daemon-stop-29]: process has finished cleanly [pid 8124]
[INFO] [daemon-start-30]: process started with pid [9416]
[daemon-start-30] C:\Python38\lib\subprocess.py:942: ResourceWarning: subprocess 7272 is still running
[daemon-start-30]   _warn("subprocess %s is still running" % self.pid,
[daemon-start-30] ResourceWarning: Enable tracemalloc to get the object allocation traceback
[daemon-start-30] sys:1: ResourceWarning: unclosed file <_io.FileIO name=4 mode='wb' closefd=True>
[daemon-start-30] ResourceWarning: Enable tracemalloc to get the object allocation traceback
[INFO] [daemon-start-30]: process has finished cleanly [pid 9416]
[INFO] [ros2security-cli-31]: process started with pid [6160]
[ros2security-cli-31] No nodes detected in the ROS graph. No policy file was generated.
[ERROR] [ros2security-cli-31]: process has died [pid 6160, exit code 1, cmd 'ros2 security generate_policy C:\Users\ContainerAdministrator\AppData\Local\Temp\tmpmx6c92nb\test-policy.xml'].
[INFO] [ros2security-cli-32]: process started with pid [8888]
[ros2security-cli-32] usage: ros2 security generate_policy [-h] [--spin-time SPIN_TIME] [-s]
[ros2security-cli-32]                                      [--no-daemon]
[ros2security-cli-32]                                      POLICY_FILE_PATH
[ros2security-cli-32] ros2 security generate_policy: error: the following arguments are required: POLICY_FILE_PATH
[ERROR] [ros2security-cli-32]: process has died [pid 8888, exit code 2, cmd 'ros2 security generate_policy'].

Starting test run test_generate_policy_no_nodes[rmw_fastrtps_cpp, False]
[INFO] [launch]: All log files can be found below C:\Users\ContainerAdministrator\.ros\log\2024-06-17-08-00-12-989365-72b9d2b249b9-8684
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [daemon-stop-33]: process started with pid [11096]
[INFO] [daemon-stop-33]: process has finished cleanly [pid 11096]
[INFO] [ros2security-cli-34]: process started with pid [2180]
[ros2security-cli-34] No nodes detected in the ROS graph. No policy file was generated.
[ERROR] [ros2security-cli-34]: process has died [pid 2180, exit code 1, cmd 'ros2 security generate_policy C:\Users\ContainerAdministrator\AppData\Local\Temp\tmpy9z1x95i\test-policy.xml --no
[INFO] [ros2security-cli-35]: process started with pid [8] 
[ros2security-cli-35] usage: ros2 security generate_policy [-h] [--spin-time SPIN_TIME] [-s]
[ros2security-cli-35]                                      [--no-daemon]
[ros2security-cli-35]                                      POLICY_FILE_PATH
[ros2security-cli-35] ros2 security generate_policy: error: the following arguments are required: POLICY_FILE_PATH
[ERROR] [ros2security-cli-35]: process has died [pid 8, exit code 2, cmd 'ros2 security generate_policy --no-daemon --spin-time 4.0'].

...

===========================================================
FAIL: test_generate_policy_no_nodes.TestSROS2GeneratePolicyVerbWithNoNodes.test_generate_policy_no_nodes[rmw_fastrtps_cpp, True]
-----------------------------------------------------------
Exception: Launch stopped before the active tests finished.

Flaky ratio (last 15 days):

job_name last_fail first_fail build_count failure_count failure_percentage
nightly_win_deb 2024-06-17 2024-06-04 15 9 60.0
nightly_win_rel 2024-06-14 2024-06-14 16 1 6.25

Copy link
Contributor Author

Jun 19

Build regressions
gz_tools-2-win|55|2024-06-19 10:18:15.158000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
gz_common-5-win|59|2024-06-19 06:52:29|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
gz_common-5-win|58|2024-06-19 04:07:01.874000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
gz_math-7-win|53|2024-06-18 15:55:10.698000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
gz_launch-6-win|58|2024-06-19 00:06:29.612000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
sdformat-sdf13-win|55|2024-06-19 02:06:40.746000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
sdformat-sdf12-win|54|2024-06-18 17:06:29.870000|Jenkins channel closing down (Agent disconnected)|vcpkg: install all dependencies
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 100.0% in 16 out of 16 builds
	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
	projectroot.test_multi_nested_message_introspection
	  (also in: "nightly_win_rep" job)

Issue #2 in nightly_win_rep
- Failing 100.0% in 14 out of 14 builds
	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)

Issue #3 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 10 out of 10 builds
	projectroot.benchmark_string_conversions
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)

Issue #4 in nightly_win_deb
- Failing 66.67% in 10 out of 15 builds
	sros2.test.sros2.commands.security.verbs.test_generate_policy_no_nodes.test_generate_policy_no_nodes
	  (also in: "nightly_win_rel" job)

Issue #5 in nightly_linux_coverage
- Failing 37.5% in 6 out of 16 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #6 in nightly_linux_repeated
- Failing 40.0% in 6 out of 15 builds
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #7 in gz_rendering-ci-main-noble-amd64
- Failing 100.0% in 5 out of 5 builds
	INTEGRATION_load_unload_ogre_gl3plus.test_ran

Issue #8 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe]

Issue #9 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test_lifecycle_service_client (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)

Issue #10 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #11 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
	  (also in: "nightly_win_rep" job)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #12 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_double_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclcpp_lifecycle.TestLifecycleServiceClientRCLErrors.call_services_rcl_errors (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all
	projectroot.test_guard_condition (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #13 in gz_rendering-7-win
- Failing 100.0% in 4 out of 4 builds
	MeshTest.NormalMapWithoutTexCoord
	  (also in: "gz_rendering-main-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-7-win" job)

Issue #14 in nightly_linux_iron_coverage
- Failing 26.67% in 4 out of 15 builds
	test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all

Issue #15 in nightly_linux_iron_coverage
- Failing 26.67% in 4 out of 15 builds
	projectroot.test_timer
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_rel" job)

Issue #16 in nightly_linux_repeated
- Failing 26.67% in 4 out of 15 builds
	projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #17 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	rclpy.test_wait_for_message.xunit.missing_result
	projectroot.test_wait_for_message
	  (also in: "nightly_win_rel" job)

Issue #18 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	projectroot.test.rclcpp.test_time (known issue in: https://github.com/ros2/rclcpp/issues/2436 - CLOSED)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2436 - CLOSED)

Issue #19 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #20 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	rclcpp.test_executor.gtest.missing_result
	projectroot.test.rclcpp.test_executor (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job)

Issue #21 in gz_sensors-ci-main-noble-amd64
- Failing 100.0% in 3 out of 3 builds
	BoundingBoxCameraSensor/BoundingBoxCameraSensorTest.BoxesWithBuiltinSDF/ogre2
	<init>.BoundingBoxCameraSensor/BoundingBoxCameraSensorTest

Issue #22 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	test_cli_remapping.TestCLIRemapping.test_topic_and_service_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe]

Issue #23 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	projectroot.test_publisher_subscriber__rclpy__rmw_fastrtps_cpp (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #24 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	rclcpp.TestInterfaceTraits.has_node_base_interface
	rclcpp.TestExecutors/SingleThreadedExecutor.detachOnDestruction
	projectroot.test.rclcpp.test_logger_service
	projectroot.test.rclcpp.test_interface_traits
	  (also in: "nightly_win_rel" job)

Issue #25 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[BoundedSequences]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[BoundedSequences]
	  (also in: "nightly_win_rel" job)

Issue #26 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
	  (also in: "nightly_win_rel" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #27 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
	  (also in: "nightly_win_rel" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #28 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclcpp.TestService.server_qos
	  (also in: "nightly_win_rel" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #29 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclcpp.TestQosEvent.test_pub_matched_event_by_option_event_callback
	  (also in: "nightly_win_rel" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #30 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclcpp.TestQosEvent.test_on_new_event_callback
	rclcpp.TestQosEvent.test_invalid_on_new_event_callback
	  (also in: "nightly_win_rel" job)
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)

Issue #31 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test.rclcpp.test_subscription_topic_statistics
	  (also in: "nightly_win_rel" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)

Issue #32 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclcpp.TestSubscription.on_new_message_callback
	rclcpp.TestService.on_new_request_callback
	projectroot.test.rclcpp.test_subscription
	  (also in: "nightly_win_rel" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)

Issue #33 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test.rclcpp.test_service_introspection
	  (also in: "nightly_win_rel" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #34 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test.rclcpp.test_service
	  (also in: "nightly_win_rel" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)

Issue #35 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	test_rclcpp.test_spin.spin_until_future_complete_interrupted
	rclcpp.TestNode.wait_for_graph_event
	rclcpp.TestNode.undeclare_parameter
	rclcpp.TestNode.test_registering_multiple_callbacks_api
	rclcpp.TestNode.static_and_dynamic_typing
	rclcpp.TestNode.set_parameters_undeclared_parameters_not_allowed
	rclcpp.TestNode.set_parameters_undeclared_parameters_allowed
	rclcpp.TestNode.set_parameters_atomically_undeclared_parameters_not_allowed
	rclcpp.TestNode.set_parameters_atomically_undeclared_parameters_allowed
	rclcpp.TestNode.set_parameter_undeclared_parameters_not_allowed
	rclcpp.TestNode.set_parameter_undeclared_parameters_allowed
	rclcpp.TestNode.parameter_uninitialized_exception_even_if_allow_undeclared
	rclcpp.TestNode.list_parameters
	rclcpp.TestNode.has_parameter
	rclcpp.TestNode.get_publishers_subscriptions_info_by_topic
	rclcpp.TestNode.get_parameters_undeclared_parameters_not_allowed
	rclcpp.TestNode.get_parameters_undeclared_parameters_allowed
	rclcpp.TestNode.get_parameter_with_node_allow_undeclared
	rclcpp.TestNode.get_parameter_undeclared_parameters_not_allowed
	rclcpp.TestNode.get_parameter_undeclared_parameters_allowed
	rclcpp.TestNode.get_parameter_types_undeclared_parameters_not_allowed
	rclcpp.TestNode.get_parameter_types_undeclared_parameters_allowed
	rclcpp.TestNode.get_parameter_or_with_return_value
	rclcpp.TestNode.get_parameter_or_undeclared_parameters_not_allowed
	rclcpp.TestNode.get_parameter_or_undeclared_parameters_allowed
	rclcpp.TestNode.get_entity_names
	rclcpp.TestNode.describe_parameters_undeclared_parameters_not_allowed
	rclcpp.TestNode.describe_parameters_undeclared_parameters_allowed
	rclcpp.TestNode.describe_parameter_undeclared_parameters_not_allowed
	rclcpp.TestNode.describe_parameter_undeclared_parameters_allowed
	rclcpp.TestNode.declare_parameters_with_no_initial_values
	rclcpp.TestNode.declare_parameter_with_vector
	rclcpp.TestNode.declare_parameter_with_overrides
	rclcpp.TestNode.declare_parameter_with_no_initial_values
	rclcpp.TestNode.declare_parameter_with_cli_overrides
	rclcpp.TestNode.declare_parameter_with_allow_undeclared_parameters
	rclcpp.TestNode.declare_parameter_allowed_simple_types_function_templates
	rclcpp.TestNode.declare_parameter_allowed_array_types_function_templates
	rclcpp.TestNode.create_sub_node_rmw_validate_namespace_error
	rclcpp.TestNode.callback_groups
	projectroot.test.rclcpp.test_node

Issue #36 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test.rclcpp.test_executors_timer_cancel_behavior
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #37 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclcpp.TestWaitSet.add_remove_wait
	rclcpp.TestWaitSet.add_guard_condition_to_two_different_wait_set
	rclcpp.TestUtilities.wait_for_message_twice_one_sub
	rclcpp.TestUtilities.wait_for_message_indefinitely
	rclcpp.TestUtilities.wait_for_message
	rclcpp.TestTypeSupport.test_service_ts_set_params_srv
	rclcpp.TestTypeSupport.test_service_ts_set_params_atomically_srv
	rclcpp.TestTypeSupport.test_service_ts_list_params_srv
	rclcpp.TestTypeSupport.test_service_ts_get_params_srv_type
	rclcpp.TestTypeSupport.test_service_ts_get_params_srv
	rclcpp.TestTypeSupport.test_service_ts_get_parameters_types_srv
	rclcpp.TestTypeSupport.test_service_ts_describe_params_srv
	rclcpp.TestTypeSupport.basic_getters
	rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testTimer2CancelledWithExecutorSpin
	rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testTimer1CancelledWithExecutorSpin
	rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testHeadTimerCancelThenResetBehavior
	rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testBothTimerCancelThenResetT2Behavior
	rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testBothTimerCancelThenResetT1Behavior
	rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testBackTimerCancelThenResetBehavior
	rclcpp.TestTimeSource.reattach
	rclcpp.TestTimeSource.parameter_activation
	rclcpp.TestTimeSource.no_pre_jump_callback
	rclcpp.TestTimeSource.detachUnattached
	rclcpp.TestTimeSource.clock_sleep_until_with_ros_time_basic
	rclcpp.TestTimeSource.clock
	rclcpp.TestTimeSource.check_use_clock_thread_value
	rclcpp.TestTimeSource.check_clock_thread_status
	rclcpp.TestTimeSource.callbacks
	rclcpp.TestTimeSource.callback_handler_erasure
	rclcpp.TestTimeSource.ROS_time_valid_wall_time
	rclcpp.TestTimeSource.ROS_time_valid_sim_time
	rclcpp.TestTimeSource.ROS_time_valid_attach_detach
	rclcpp.TestTimeSource.ROS_invalid_sim_time
	rclcpp.TestThreadSafeStorage.wait_waitable
	rclcpp.TestThreadSafeStorage.wait_timer
	rclcpp.TestThreadSafeStorage.wait_subscription
	rclcpp.TestThreadSafeStorage.wait_client_service
	rclcpp.TestThreadSafeStorage.iterables_construct_destruct
	rclcpp.TestThreadSafeStorage.default_construct_destruct
	rclcpp.TestThreadSafeStorage.add_remove_out_of_scope
	rclcpp.TestThreadSafeStorage.add_remove_nullptr
	rclcpp.TestThreadSafeStorage.add_remove_dynamically
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_invalid_publish_period
	rclcpp.TestSubscriptionPublisherCount/one_context_test.increasing_and_decreasing_counts
	rclcpp.TestSubscriptionOptions.topic_statistics_options_node_default_mode
	rclcpp.TestSubscription.various_creation_signatures
	rclcpp.TestSubscription.take_serialized
	rclcpp.TestSubscription.take
	rclcpp.TestSubscription.rcl_take_type_erased_error
	rclcpp.TestSubscription.rcl_take_serialized_message_error
	rclcpp.TestSubscription.rcl_subscription_init_error
	rclcpp.TestSubscription.rcl_subscription_get_publisher_count_error
	rclcpp.TestSubscription.rcl_subscription_get_actual_qos_error
	rclcpp.TestSubscription.rcl_subscription_fini_error
	rclcpp.TestSubscription.on_new_intra_process_message_callback
	rclcpp.TestSubscription.handle_loaned_message
	rclcpp.TestSubscription.get_network_flow_endpoints_errors
	rclcpp.TestSubscription.construction_and_destruction
	rclcpp.TestSubscription.callback_bind
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_resize_error
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_fini_error
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_clear_error
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_timer_error
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_subscription_error
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_service_error
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_guard_condition_error
	rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_client_error
	rclcpp.TestStoragePolicyCommon.add_waitable_error
	rclcpp.TestStaticStorage.wait_waitable
	rclcpp.TestStaticStorage.wait_timer
	rclcpp.TestStaticStorage.wait_subscription
	rclcpp.TestStaticStorage.wait_guard_condition
	rclcpp.TestStaticStorage.wait_client_service
	rclcpp.TestStaticStorage.iterables_construct_destruct
	rclcpp.TestStaticStorage.fixed_storage_needs_pruning
	rclcpp.TestStaticSingleThreadedExecutor.add_callback_group_trigger_guard_failed
	rclcpp.TestServiceIntrospection.service_introspection_nominal
	rclcpp.TestService.take_request
	rclcpp.TestService.server_qos_depth
	rclcpp.TestService.send_response
	rclcpp.TestService.rcl_service_response_publisher_get_actual_qos_error
	rclcpp.TestService.rcl_service_request_subscription_get_actual_qos_error
	rclcpp.TestService.construction_and_destruction_rcl_errors
	rclcpp.TestService.construction_and_destruction
	rclcpp.TestService.basic_public_getters
	rclcpp.TestSerializedMessageAllocator.borrow_from_subscription
	rclcpp.TestRosoutSubscription.test_rosoutsubscription_parent_log
	rclcpp.TestRosoutSubscription.test_rosoutsubscription_node_rosout_disabled
	rclcpp.TestRosoutSubscription.test_rosoutsubscription_getchild_hierarchy
	rclcpp.TestRosoutSubscription.test_rosoutsubscription_getchild
	rclcpp.TestRosoutSubscription.test_rosoutsubscription_child_log
	rclcpp.TestQosParameters.declare_with_id
	rclcpp.TestQosParameters.declare_with_callback
	rclcpp.TestQosParameters.declare_qos_subscription_parameters
	rclcpp.TestQosParameters.declare_no_parameters_interface
	rclcpp.TestQosParameters.declare
	rclcpp.TestQosEvent.test_subscription_constructor
	rclcpp.TestQosEvent.test_sub_matched_event_by_set_event_callback
	rclcpp.TestQosEvent.test_sub_matched_event_by_option_event_callback
	rclcpp.TestQosEvent.test_publisher_constructor
	rclcpp.TestQosEvent.test_pub_matched_event_by_set_event_callback
	rclcpp.TestQosEvent.test_default_incompatible_qos_callbacks
	rclcpp.TestQosEvent.execute
	rclcpp.TestQosEvent.construct_destruct_rcl_error
	rclcpp.TestQosEvent.add_to_wait_set
	rclcpp.TestMultiThreadedExecutor.timer_over_take
	rclcpp.TestLoggerService.check_connect_get_logger_service
	rclcpp.TestLogger.get_node_logger
	rclcpp.TestIntraprocessExecutors/SingleThreadedExecutor.testIntraprocessRetrigger
	rclcpp.TestIntraProcessWaitable.test_that_waitable_stays_ready_after_second_wait
	rclcpp.TestGraphListener.construction_and_destruction
	rclcpp.TestFindWeakNodes.allocator_strategy_with_weak_nodes
	rclcpp.TestFindWeakNodes.allocator_strategy_no_weak_nodes
	rclcpp.TestExternallyDefinedServices.extern_defined_uninitialized
	rclcpp.TestExternallyDefinedServices.extern_defined_initialized
	rclcpp.TestExternallyDefinedServices.extern_defined_destructor
	rclcpp.TestExternallyDefinedServices.default_behavior
	rclcpp.TestExecutorNotifyWaitable.add_remove_guard_conditions
	rclcpp.TestExecutorEntitiesCollector.add_remove_node
	rclcpp.TestEventsExecutor.run_pub_sub
	rclcpp.TestDynamicStorage.wait_waitable
	rclcpp.TestDynamicStorage.wait_timer
	rclcpp.TestDynamicStorage.wait_subscription
	rclcpp.TestDynamicStorage.wait_client_service
	rclcpp.TestDynamicStorage.iterables_construct_destruct
	rclcpp.TestDynamicStorage.default_construct_destruct
	rclcpp.TestDynamicStorage.add_remove_out_of_scope
	rclcpp.TestDynamicStorage.add_remove_nullptr
	rclcpp.TestDynamicStorage.add_remove_dynamically
	rclcpp.TestContentFilterSubscription.set_content_filter_error
	rclcpp.TestContentFilterSubscription.set_content_filter
	rclcpp.TestContentFilterSubscription.is_cft_enabled
	rclcpp.TestContentFilterSubscription.get_content_filter_error
	rclcpp.TestContentFilterSubscription.get_content_filter
	rclcpp.TestContentFilterSubscription.create_two_content_filters_with_same_topic_name_and_destroy
	rclcpp.TestContentFilterSubscription.content_filter_reset
	rclcpp.TestContentFilterSubscription.content_filter_get_later
	rclcpp.TestContentFilterSubscription.content_filter_get_begin
	rclcpp.TestClockSleep.bad_clock_type
	rclcpp.TestCallbackGroup.valid_callback_group
	rclcpp.TestCallbackGroup.invalid_callback_group
	rclcpp.RclcppGenericNodeFixture.generic_subscription_different_callbacks
	rclcpp.RclcppGenericNodeFixture.generic_publisher_uses_qos
	rclcpp.PerTimerType/TestTimer.test_simple_cancel/wall_timer (4-byte object <00-00 00-00>)                     
	projectroot.test.rclcpp.test_wait_set
	projectroot.test.rclcpp.test_wait_for_message
	projectroot.test.rclcpp.test_type_support
	projectroot.test.rclcpp.test_timer (known issue in: https://github.com/ros2/rclcpp/issues/2436 - CLOSED)
	projectroot.test.rclcpp.test_time_source
	projectroot.test.rclcpp.test_thread_safe_synchronization
	projectroot.test.rclcpp.test_subscription_publisher_count_api
	projectroot.test.rclcpp.test_subscription_options
	projectroot.test.rclcpp.test_subscription_content_filter__rmw_fastrtps_cpp
	projectroot.test.rclcpp.test_storage_policy_common
	projectroot.test.rclcpp.test_static_storage
	projectroot.test.rclcpp.test_static_single_threaded_executor
	projectroot.test.rclcpp.test_serialized_message_allocator
	projectroot.test.rclcpp.test_rosout_subscription
	projectroot.test.rclcpp.test_qos_parameters
	projectroot.test.rclcpp.test_qos_event__rmw_fastrtps_cpp
	projectroot.test.rclcpp.test_multi_threaded_executor
	projectroot.test.rclcpp.test_logger
	projectroot.test.rclcpp.test_intra_process_waitable
	projectroot.test.rclcpp.test_graph_listener
	projectroot.test.rclcpp.test_generic_pubsub__rmw_fastrtps_cpp
	projectroot.test.rclcpp.test_find_weak_nodes
	projectroot.test.rclcpp.test_externally_defined_services
	projectroot.test.rclcpp.test_executors_intraprocess
	projectroot.test.rclcpp.test_executors_callback_group_behavior
	projectroot.test.rclcpp.test_executor_notify_waitable
	projectroot.test.rclcpp.test_events_executor
	projectroot.test.rclcpp.test_entities_collector
	projectroot.test.rclcpp.test_dynamic_storage
	  (also in: "nightly_win_rel" job)

Issue #38 in gz_transport-13-win
- Failing 20.0% in 1 out of 5 builds
	playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport8-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport11-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)

Issue #39 in nightly_linux-aarch64_release
- Failing 6.25% in 1 out of 16 builds
	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_linux_debug" job)

Issue #40 in nightly_linux-aarch64_release
- Failing 6.25% in 1 out of 16 builds
	test_security.TestSecurePublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_1
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_0
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_2
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_1
	projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_0
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_linux_debug" job)

Issue #41 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	test_rclcpp.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp.xunit.missing_result
	projectroot.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #42 in nightly_win_deb
- Failing 6.67% in 1 out of 15 builds
	test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]
	test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/build/test_cli_remapping/Debug/name_maker_rclcpp.exe]
	test_cli_remapping.TestCLIRemapping.test_topic_and_service_replacement[C:/ci/ws/build/test_cli_remapping/Debug/name_maker_rclcpp.exe]
	test_cli_remapping.TestCLIRemapping.test_service_replacement[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py]

Issue #43 in nightly_win_deb
- Failing 6.67% in 1 out of 15 builds
	projectroot.test_cli_remapping
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #44 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	rcl.TestTwoExecutablesAfterShutdown.test_services
	projectroot.test.test_services__rmw_fastrtps_cpp

Copy link
Contributor Author

Jun 20

Build regressions
nightly_linux_repeated|3491|2024-06-19 13:05:17.411000|Jenkins channel closing down (Agent disconnected)|Build Dockerfile
nightly_linux-aarch64_release|2768|2024-06-20 04:00:01.005000|Jenkins channel closing down (Agent disconnected)|build
nightly_linux-rhel_debug|1951|2024-06-20 04:00:01.019000|Jenkins channel closing down (Agent disconnected)|build
nightly_linux-rhel_repeated|1936|2024-06-20 04:15:59.959000|Jenkins channel closing down (Agent disconnected)|test
Ici__nightly-fastrtps_ubuntu_jammy_amd64|136|2024-06-19 22:21:09.202000|Jenkins channel closing down (Agent disconnected)|build workspace in isolation and install
Rci__nightly-performance_ubuntu_noble_amd64|45|2024-06-19 18:56:42.282000|Jenkins channel closing down (Agent disconnected)|run tests
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 100.0% in 16 out of 16 builds
	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
	projectroot.test_multi_nested_message_introspection
	  (also in: "nightly_win_rep" job)

Issue #2 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 10 out of 10 builds
	projectroot.benchmark_string_conversions
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)

Issue #3 in nightly_win_deb
- Failing 66.67% in 10 out of 15 builds
	sros2.test.sros2.commands.security.verbs.test_generate_policy_no_nodes.test_generate_policy_no_nodes
	  (also in: "nightly_win_rel" job)

Issue #4 in nightly_win_deb
- Failing 66.67% in 10 out of 15 builds
	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)

Issue #5 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	projectroot.test_lifecycle_service_client (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)

Issue #6 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #7 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
	  (also in: "nightly_win_rep" job)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #8 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_double_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclcpp_lifecycle.TestLifecycleServiceClientRCLErrors.call_services_rcl_errors (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all
	projectroot.test_guard_condition (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #9 in nightly_linux_iron_coverage
- Failing 31.25% in 5 out of 16 builds
	test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all

Issue #10 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	test_rclcpp.test_timeout_subscriber.timeout_subscriber

Issue #11 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	rclpy.test_wait_for_message.xunit.missing_result
	rclpy.test_subscription.xunit.missing_result
	projectroot.test_wait_for_message

Issue #12 in nightly_linux_iron_coverage
- Failing 31.25% in 5 out of 16 builds
	projectroot.test_timer
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_iron_coverage" job)

Issue #13 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	projectroot.test_subscription
	  (also in: "Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #14 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #15 in gz_rendering-ci-main-noble-amd64
- Failing 100.0% in 4 out of 4 builds
	INTEGRATION_load_unload_ogre_gl3plus.test_ran

Issue #16 in gz_rendering-7-win
- Failing 100.0% in 4 out of 4 builds
	MeshTest.NormalMapWithoutTexCoord
	  (also in: "gz_rendering-main-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-7-win" job)

Issue #17 in gz_sensors-ci-main-noble-amd64
- Failing 100.0% in 4 out of 4 builds
	BoundingBoxCameraSensor/BoundingBoxCameraSensorTest.BoxesWithBuiltinSDF/ogre2
	<init>.BoundingBoxCameraSensor/BoundingBoxCameraSensorTest

Issue #18 in nightly_linux_repeated
- Failing 26.67% in 4 out of 15 builds
	test_rclcpp.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp.xunit.missing_result
	projectroot.test_node_name__rmw_cyclonedds_cpp__rmw_fastrtps_cpp
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #19 in nightly_win_rel
- Failing 25.0% in 4 out of 16 builds
	ros2cli.ros2cli.test.test_daemon.test_get_name

Issue #20 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	rclpy.test_waitable.xunit.missing_result
	projectroot.test_waitable
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #21 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	rclpy.test_timer.xunit.missing_result
	rclpy.test_time_source.xunit.missing_result
	projectroot.test_time_source
	projectroot.test_service

Issue #22 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	rclpy.test_service.xunit.missing_result

Issue #23 in nightly_linux_repeated
- Failing 13.33% in 2 out of 15 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Constants] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #24 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclpy.test_service_introspection.xunit.missing_result
	rclpy.test_rosout_subscription.xunit.missing_result
	rclpy.test_rate.xunit.missing_result
	rclpy.test_qos_overriding_options.xunit.missing_result
	rclpy.test_qos_event.xunit.missing_result
	rclpy.test_publisher.xunit.missing_result
	projectroot.test_service_introspection
	projectroot.test_rosout_subscription
	projectroot.test_rate
	projectroot.test_qos_overriding_options
	projectroot.test_qos_event

Issue #25 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #26 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	rclpy.test_node.xunit.missing_result
	projectroot.test_node

Issue #27 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.gtest_timeout_subscriber__rmw_fastrtps_cpp

Issue #28 in gz_transport-13-win
- Failing 16.67% in 1 out of 6 builds
	twoProcSrvCall.ServiceList

Issue #29 in nightly_linux_humble_coverage
- Failing 6.25% in 1 out of 16 builds
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_running
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux_debug" job)

Issue #30 in nightly_linux_humble_coverage
- Failing 6.25% in 1 out of 16 builds
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn
	ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon
	  (also in: "nightly_linux_debug" job)

Issue #31 in nightly_linux_iron_coverage
- Failing 6.25% in 1 out of 16 builds
	test_tracetools.test_tracetools.test.test_lifecycle_node.TestLifecycleNode.test_all

Issue #32 in nightly_linux_iron_coverage
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_lifecycle_node
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #33 in nightly_linux_repeated
- Failing 6.67% in 1 out of 15 builds
	projectroot.test_publisher_subscriber__rclpy__rclcpp__rmw_fastrtps_cpp
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_rel" job)

Issue #34 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_running[3-3]
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_running[2-3]
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_running[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_topic_names_and_types[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_topic_names_and_types[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_topic_names_and_types[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_subscriptions_info_by_topic[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_subscriptions_info_by_topic[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_subscriptions_info_by_topic[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_subscriber_names_and_types_by_node[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_subscriber_names_and_types_by_node[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_subscriber_names_and_types_by_node[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_service_names_and_types_by_node[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_service_names_and_types_by_node[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_service_names_and_types_by_node[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_service_names_and_types[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_service_names_and_types[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_service_names_and_types[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_publishers_info_by_topic[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_publishers_info_by_topic[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_publishers_info_by_topic[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_publisher_names_and_types_by_node[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_publisher_names_and_types_by_node[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_publisher_names_and_types_by_node[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_node_names_and_namespaces_with_enclaves[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_node_names_and_namespaces_with_enclaves[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_node_names_and_namespaces_with_enclaves[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_node_names_and_namespaces[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_node_names_and_namespaces[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_node_names_and_namespaces[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_namespace[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_namespace[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_namespace[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_name[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_name[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_name[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_client_names_and_types_by_node[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_client_names_and_types_by_node[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_client_names_and_types_by_node[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_server_names_and_types_by_node[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_server_names_and_types_by_node[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_server_names_and_types_by_node[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_names_and_types[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_names_and_types[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_names_and_types[1-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_client_names_and_types_by_node[3-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_client_names_and_types_by_node[2-3]
	ros2cli.ros2cli.test.test_daemon.test_get_action_client_names_and_types_by_node[1-3]
	ros2cli.ros2cli.test.test_daemon.test_count_subscribers[3-3]
	ros2cli.ros2cli.test.test_daemon.test_count_subscribers[2-3]
	ros2cli.ros2cli.test.test_daemon.test_count_subscribers[1-3]
	ros2cli.ros2cli.test.test_daemon.test_count_services[3-3]
	ros2cli.ros2cli.test.test_daemon.test_count_services[2-3]
	ros2cli.ros2cli.test.test_daemon.test_count_services[1-3]
	ros2cli.ros2cli.test.test_daemon.test_count_publishers[3-3]
	ros2cli.ros2cli.test.test_daemon.test_count_publishers[2-3]
	ros2cli.ros2cli.test.test_daemon.test_count_publishers[1-3]
	ros2cli.ros2cli.test.test_daemon.test_count_clients[3-3]
	ros2cli.ros2cli.test.test_daemon.test_count_clients[2-3]
	ros2cli.ros2cli.test.test_daemon.test_count_clients[1-3]
	rclpy.test_parameter_service.xunit.missing_result
	rclpy.test_parameter_event_handler.xunit.missing_result
	rclpy.test_parameter_client.xunit.missing_result
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin
	projectroot.test_parameter_service
	projectroot.test_parameter_event_handler
	projectroot.test_parameter_client

@Crola1702
Copy link
Contributor

Gz transport13 | Test regression | Keeping track 👀

Reference build: https://build.osrfoundation.org/job/gz_transport-13-win/61/

Test failure:

Log output:

C:\J\workspace\gz_transport-13-win\ws\gz-transport\test\integration\twoProcsSrvCall.cc:278
Expected: (elapsed2) <= (elapsed1), actual: 8-byte object <34-F6 02-00 00-00 00-00> vs 8-byte object <3C-1C 02-00 00-00 00-00>
Elapsed2[194100] Elapsed1[138300]

It's the first time happening, however, in the same build we can see:

# BEGIN SECTION: clean up workspace
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\bin\Release\gz-transport13.dll - Access is denied.
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\bin\Release\libprotobuf.dll - Access is denied.
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\bin\Release\libzmq-mt-4_3_4.dll - Access is denied.
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\bin\Release\twoProcsSrvCallReplierInc_aux.exe - Access is denied.
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\bin\Release\twoProcsSrvCallWithoutInputReplierInc_aux.exe - Access is denied.
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\bin\Release\twoProcsSrvCallWithoutOutputReplierInc_aux.exe - Access is denied.
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\test\INTEGR~1 - The process cannot access the file because it is being used by another process.
C:\J\workspace\gz_transport-13-win\ws\build\GZ-TRA~1\Testing\TEMPOR~1\LastTest_20240619-1741.log.tmp - The process cannot access the file because it is being used by another process.
C:\J\workspace\gz_transport-13-win\ws\install\GZ-MSG~1\bin\gz-msgs10.dll - Access is denied.
C:\J\workspace\gz_transport-13-win\ws\install\GZ-UTI~1\bin\gz-utils2.dll - Access is denied.
# END SECTION

Keeping track

Copy link
Contributor Author

Jun 21

Build regressions
nightly_linux-aarch64_debug|2805|2024-06-21 04:00:01.179000|Jenkins channel closing down (Agent disconnected)|test
nightly_linux-rhel_debug|1952|2024-06-20 12:06:51.630000|Jenkins channel closing down (Agent disconnected)|build
Jci__nightly-release_ubuntu_noble_amd64|25|2024-06-20 14:56:25.970000|Number of failed test exceeds the threshold|run tests
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 100.0% in 16 out of 16 builds
	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
	projectroot.test_multi_nested_message_introspection
	  (also in: "nightly_win_rep" job)

Issue #2 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 11 out of 11 builds
	projectroot.benchmark_string_conversions
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)

Issue #3 in nightly_win_deb
- Failing 53.33% in 8 out of 15 builds
	test_rclcpp.test_multithreaded.multi_access_publisher
	  (also in: "nightly_win_rep" job)

Issue #4 in gz_rendering-ci-main-noble-amd64
- Failing 100.0% in 5 out of 5 builds
	INTEGRATION_load_unload_ogre_gl3plus.test_ran

Issue #5 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test_lifecycle_service_client (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)

Issue #6 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #7 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #8 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
	  (also in: "nightly_win_rep" job)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #9 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_double_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclcpp_lifecycle.TestLifecycleServiceClientRCLErrors.call_services_rcl_errors (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all
	projectroot.test_guard_condition (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #10 in gz_sensors-ci-main-noble-amd64
- Failing 100.0% in 4 out of 4 builds
	BoundingBoxCameraSensor/BoundingBoxCameraSensorTest.BoxesWithBuiltinSDF/ogre2
	<init>.BoundingBoxCameraSensor/BoundingBoxCameraSensorTest

Issue #11 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	projectroot.test_publisher_subscriber__rclcpp__rmw_fastrtps_cpp
	  (also in: "nightly_win_rel" job)

Issue #12 in gz_rendering-7-win
- Failing 100.0% in 3 out of 3 builds
	MeshTest.NormalMapWithoutTexCoord
	  (also in: "gz_rendering-main-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-7-win" job)

Issue #13 in nightly_linux_repeated
- Failing 18.75% in 3 out of 16 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Constants] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #14 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[UnboundedSequences]
	  (also in: "nightly_win_rel" job)

Issue #15 in gz_transport-13-win
- Failing 28.57% in 2 out of 7 builds
	playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport8-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport11-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)

Issue #16 in nightly_linux-aarch64_repeated
- Failing 13.33% in 2 out of 15 builds
	projectroot.src.core.ddsc.tests.CUnit_ddsc_discstress_create_writer

Issue #17 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_record__rmw_cyclonedds_cpp
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #18 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)

Issue #19 in nightly_linux_repeated
- Failing 12.5% in 2 out of 16 builds
	ros2action.ros2action.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED)

Issue #20 in nightly_linux_repeated
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_publisher_subscriber__rclpy__rclcpp__rmw_fastrtps_cpp
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_rel" job)

Issue #21 in Hci__nightly-debug_ubuntu_jammy_amd64
- Failing 25.0% in 1 out of 4 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #22 in gz_sim-main-win
- Failing 20.0% in 1 out of 5 builds
	MeshInertiaCalculationTest.CylinderColladaMeshInertiaCalculation

Issue #23 in gz_sim-main-win
- Failing 20.0% in 1 out of 5 builds
	INTEGRATION_multiple_servers.test_ran
	  (also in: "gz_sim-ign-gazebo6-win" job)
	  (also in: "gz_sim-8-win" job)

Issue #24 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	robot_state_publisher.TestMovingJoint.test_termination

Issue #25 in nightly_win_deb
- Failing 6.67% in 1 out of 15 builds
	rclpy.rclpy.test.test_rate.TestRate.test_rate_valid_period

Issue #26 in nightly_win_deb
- Failing 6.67% in 1 out of 15 builds
	projectroot.test_rate
	  (also in: "nightly_win_rep" job)

Issue #27 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_tutorial_add_two_ints_server_add_two_ints_client_async__rmw_fastrtps_cpp
	  (also in: "nightly_win_rep" job)

Issue #28 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code
	  (also in: "nightly_win_rep" job)

Issue #29 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	robot_state_publisher.MovingJointTestAfterShutdown.test_exit_code
	projectroot.test_two_links_moving_joint_launch.py
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #30 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	test_rclcpp.test_time.timer_during_wait
	test_rclcpp.test_time.finite_timer
	rosbag2_transport.Rosbag2PlayCallbacksTestFixture.call_callbacks
	robot_state_publisher.FixedJointTestAfterShutdown.test_exit_code
	robot_state_publisher.ChangeFixedJointTestAfterShutdown.test_exit_code
	rcl.TestGraphFixture.test_graph_guard_condition_trigger_check
	rcl.TestGetNodeNames.test_rcl_get_node_names_with_enclave
	projectroot.test_two_links_fixed_joint_prefix_launch.py
	projectroot.test_two_links_fixed_joint_launch.py
	projectroot.test_two_links_change_fixed_joint_launch.py
	projectroot.test_play_publish_clock__rmw_cyclonedds_cpp
	projectroot.test_play_callbacks__rmw_fastrtps_cpp
	projectroot.test_change_mimic_joint_launch.py
	projectroot.gtest_timer__rmw_fastrtps_cpp

Issue #31 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)

@Crola1702
Copy link
Contributor

Gz-sim main windows | Test regression | Keeping track

Reference build: https://build.osrfoundation.org/job/gz_sim-main-win/62/

Test regressions:

Log output (MeshInertiaCalculationTest)

171: [ RUN      ] MeshInertiaCalculationTest.CylinderColladaMeshInertiaCalculation
171: No HOME defined in the environment. Will not log.
171: �[31m[Err] [C:\J\workspace\gz_sim-main-win\ws\gz-sim\src\systems\physics\Physics.cc:816] �[m�[31mFailed to find plugin [�[m�[31mgz-physics-dartsim-plugin�[m�[31m]. Have you checked the �[m�[31mGZ_SIM_PHYSICS_ENGINE_PATH�[m�[31m environment variable?�[m�[31m
171: �[munknown file: error: SEH exception with code 0xc0000005 thrown in the test body.
171: [  FAILED  ] MeshInertiaCalculationTest.CylinderColladaMeshInertiaCalculation (2280 ms)
171: [ RUN      ] MeshInertiaCalculationTest.CylinderColladaMeshWithNonCenterOriginInertiaCalculation
171: �[31m[Err] [C:\J\workspace\gz_sim-main-win\ws\gz-sim\src\systems\physics\Physics.cc:816] �[m�[31mFailed to find plugin [�[m�[31mgz-physics-dartsim-plugin�[m�[31m]. Have you checked the �[m�[31mGZ_SIM_PHYSICS_ENGINE_PATH�[m�[31m environment variable?�[m�[31m
171: �[m[       OK ] MeshInertiaCalculationTest.CylinderColladaMeshWithNonCenterOriginInertiaCalculation (430 ms)
171: [----------] 2 tests from MeshInertiaCalculationTest (2711 ms total)
171: 
171: [----------] Global test environment tear-down
171: [==========] 2 tests from 1 test suite ran. (2711 ms total)
171: [  PASSED  ] 1 test.
171: [  FAILED  ] 1 test, listed below:
171: [  FAILED  ] MeshInertiaCalculationTest.CylinderColladaMeshInertiaCalculation
171: 
171:  1 FAILED TEST
171/248 Test #171: INTEGRATION_mesh_inertia_calculation ...................***Failed    2.86 sec

Log output (INTEGRATION_multiple_servers):

181: �[m�[32m[Msg] �[m�[32mLoading SDF string. File path not available.
181: �[m�[32m[Msg] �[m�[32mServing entity system service on [�[m�[32m/�[m�[32mentity/system/add�[m�[32m]�[m�[32m
181: �[m�[36m[Dbg] [C:\J\workspace\gz_sim-main-win\ws\gz-sim\src\SystemManager.cc:74] �[m�[36mLoaded system [�[m�[36mgz::sim::systems::SceneBroadcaster�[m�[36m] for entity [�[m�[36m1�[m�[36m]�[m�[36m
181: �[m�[32m[Msg] �[m�[32mCreate service on [�[m�[32m/world/default/create�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mRemove service on [�[m�[32m/world/default/remove�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mPose service on [�[m�[32m/world/default/set_pose�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mPose service on [�[m�[32m/world/default/set_pose_vector�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mLight configuration service on [�[m�[32m/world/default/light_config�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mPhysics service on [�[m�[32m/world/default/set_physics�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mSphericalCoordinates service on [�[m�[32m/world/default/set_spherical_coordinates�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mEnable collision service on [�[m�[32m/world/default/enable_collision�[m�[32m]�[m�[32m
181: �[m�[32m[Msg] �[m�[32mDisable collision serv
181/248 Test #181: INTEGRATION_multiple_servers ...........................Exit code 0xc0000374
***Exception:   2.81 sec

Copy link
Contributor Author

Jun 22

Build regressions

Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 100.0% in 16 out of 16 builds
	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
	projectroot.test_multi_nested_message_introspection
	  (also in: "nightly_win_rep" job)

Issue #2 in nightly_win_rep
- Failing 100.0% in 14 out of 14 builds
	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)

Issue #3 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 9 out of 9 builds
	projectroot.benchmark_string_conversions
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)

Issue #4 in nightly_win_deb
- Failing 57.14% in 8 out of 14 builds
	test_rclcpp.test_multithreaded.multi_access_publisher
	  (also in: "nightly_win_rep" job)

Issue #5 in nightly_linux_repeated
- Failing 43.75% in 7 out of 16 builds
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock
	projectroot.test.rclcpp.test_clock
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #6 in gz_rendering-ci-main-noble-amd64
- Failing 100.0% in 5 out of 5 builds
	INTEGRATION_load_unload_ogre_gl3plus.test_ran

Issue #7 in nightly_linux_iron_coverage
- Failing 31.25% in 5 out of 16 builds
	test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all

Issue #8 in nightly_win_rep
- Failing 35.71% in 5 out of 14 builds
	test_rclcpp.test_timeout_subscriber.timeout_subscriber

Issue #9 in nightly_linux_iron_coverage
- Failing 31.25% in 5 out of 16 builds
	projectroot.test_timer
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux_iron_coverage" job)

Issue #10 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test_lifecycle_service_client (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)

Issue #11 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #12 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #13 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
	  (also in: "nightly_win_rep" job)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #14 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 4 out of 4 builds
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_double_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclcpp_lifecycle.TestLifecycleServiceClientRCLErrors.call_services_rcl_errors (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all
	projectroot.test_guard_condition (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #15 in gz_rendering-7-win
- Failing 100.0% in 4 out of 4 builds
	MeshTest.NormalMapWithoutTexCoord
	  (also in: "gz_rendering-main-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-7-win" job)

Issue #16 in gz_sensors-ci-main-noble-amd64
- Failing 100.0% in 4 out of 4 builds
	BoundingBoxCameraSensor/BoundingBoxCameraSensorTest.BoxesWithBuiltinSDF/ogre2
	<init>.BoundingBoxCameraSensor/BoundingBoxCameraSensorTest

Issue #17 in nightly_linux_repeated
- Failing 25.0% in 4 out of 16 builds
	ros2param.ros2param.test.test_verb_load.test_verb_load (known issue in: https://github.com/ros2/rmw_fastrtps/issues/531 - CLOSED | https://github.com/ros2/ros2cli/issues/861 - CLOSED)

Issue #18 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	projectroot.test.rclcpp.test_time_source
	  (also in: "nightly_win_rel" job)

Issue #19 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code
	  (also in: "nightly_win_rel" job)

Issue #20 in gz_transport-13-win
- Failing 33.33% in 2 out of 6 builds
	playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport8-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport11-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)

Issue #21 in nightly_linux_repeated
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_showimage_cam2image__rmw_cyclonedds_cpp
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #22 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[UnboundedSequences]
	  (also in: "nightly_win_rep" job)

Issue #23 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Strings] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #24 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Empty] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #25 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Constants] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #26 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[BoundedPlainSequences] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #27 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[BoundedSequences]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[BoundedSequences]
	  (also in: "nightly_win_rep" job)

Issue #28 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestRequesterReplierAfterShutdown.test_processes_finished_gracefully[Arrays]
	test_communication.TestRequesterReplier.test_requester_finishes_in_a_finite_amount_of_time[Arrays]
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Arrays]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[Arrays]
	projectroot.test_requester_replier__rclpy__rmw_fastrtps_cpp
	  (also in: "nightly_win_rep" job)

Issue #29 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_publisher_subscriber__rclpy__rmw_fastrtps_cpp (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #30 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_publisher_subscriber__rclpy__rclcpp__rmw_fastrtps_cpp
	  (also in: "nightly_linux_repeated" job)

Issue #31 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_publisher_subscriber__rclcpp__rmw_fastrtps_cpp
	  (also in: "nightly_win_rep" job)

Issue #32 in nightly_win_rel
- Failing 12.5% in 2 out of 16 builds
	test_communication.TestRequesterReplierAfterShutdown.test_processes_finished_gracefully[Empty]
	test_communication.TestRequesterReplierAfterShutdown.test_processes_finished_gracefully[BasicTypes]
	test_communication.TestRequesterReplier.test_requester_finishes_in_a_finite_amount_of_time[Empty]
	test_communication.TestRequesterReplier.test_requester_finishes_in_a_finite_amount_of_time[BasicTypes]
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[WStrings] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Nested]
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[MultiNested] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Defaults]
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[Builtins]
	test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[BasicTypes] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[WStrings]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[UnboundedSequences]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[Strings]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[Nested]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[MultiNested]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[Empty] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[Defaults]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[Constants]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[Builtins]
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[BoundedPlainSequences] (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	test_communication.TestPublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time[BasicTypes]
	test_communication.TestActionClientServerAfterShutdown.test_processes_finished_gracefully[NestedMessage]
	test_communication.TestActionClientServerAfterShutdown.test_processes_finished_gracefully[Fibonacci]
	test_communication.TestActionClientServer.test_client_finishes_in_a_finite_amount_of_time[NestedMessage]
	test_communication.TestActionClientServer.test_client_finishes_in_a_finite_amount_of_time[Fibonacci]
	projectroot.test_requester_replier__rclpy__rclcpp__rmw_fastrtps_cpp
	projectroot.test_requester_replier__rclcpp__rmw_fastrtps_cpp
	projectroot.test_requester_replier__rclcpp__rclpy__rmw_fastrtps_cpp
	projectroot.test_publisher_subscriber__rclcpp__rclpy__rmw_fastrtps_cpp (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_action_client_server__rclpy__rmw_fastrtps_cpp
	projectroot.test_action_client_server__rclpy__rclcpp__rmw_fastrtps_cpp
	projectroot.test_action_client_server__rclcpp__rmw_fastrtps_cpp
	projectroot.test_action_client_server__rclcpp__rclpy__rmw_fastrtps_cpp

Issue #33 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-aarch64_release" job)

Issue #34 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	test_rclcpp.TestNNodes.test_10_nodes
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #35 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test_tutorial_talker_listener__rmw_fastrtps_cpp

Issue #36 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes
	projectroot.test_n_nodes__rmw_fastrtps_cpp
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #37 in Hci__nightly-debug_ubuntu_jammy_amd64
- Failing 33.33% in 1 out of 3 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #38 in gz_sim-ign-gazebo6-win
- Failing 20.0% in 1 out of 5 builds
	INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-7-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)

Issue #39 in gz_sim-main-win
- Failing 20.0% in 1 out of 5 builds
	INTEGRATION_mesh_inertia_calculation.test_ran

Issue #40 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #41 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_two_links_fixed_joint_prefix_launch.py
	  (also in: "nightly_win_rep" job)

Issue #42 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_tf2_sensor_msgs_cpp

Issue #43 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #44 in nightly_linux-rhel_debug
- Failing 6.25% in 1 out of 16 builds
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #45 in nightly_linux-rhel_debug
- Failing 6.25% in 1 out of 16 builds
	test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)

Issue #46 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_tf2_geometry_msgs
	projectroot.display_factory_test
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #47 in nightly_win_deb
- Failing 7.14% in 1 out of 14 builds
	rclpy.rclpy.test.test_rate.TestRate.test_rate_valid_period

Issue #48 in nightly_win_deb
- Failing 7.14% in 1 out of 14 builds
	projectroot.test_rate
	  (also in: "nightly_win_rep" job)

Issue #49 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #50 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	rclpy.rclpy.test.test_timer.test_zero_callback[0.1]
	rclcpp_components.TestComponentManager.components_api
	rclcpp.test_time_source.gtest.missing_result
	projectroot.test_tutorial_content_filtering_publisher_content_filtering_subscriber__rmw_fastrtps_cpp
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_fastrtps_cpp__secure_comm_3
	projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_fastrtps_cpp__non_secure_comm_3
	projectroot.test_record_all__rmw_cyclonedds_cpp
	projectroot.test_component_manager_api

Copy link
Contributor Author

Jun 23

Build regressions
nightly_linux_humble_coverage|839|2024-06-23 06:01:24.905000|Number of failed test exceeds the threshold|ccache stats (after)
nightly_linux_iron_coverage|471|2024-06-23 06:28:53.131000|Jenkins channel closing down (Agent disconnected)|build
nightly_linux-rhel_debug|1956|2024-06-23 04:00:01.302000|Jenkins channel closing down (Agent disconnected)|build
packaging_linux-rhel|1978|2024-06-23 09:32:00.479000|Jenkins channel closing down (Agent disconnected)|build underlay packages
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux_coverage
- Failing 100.0% in 16 out of 16 builds
	rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage
	projectroot.test_multi_nested_message_introspection
	  (also in: "nightly_win_rep" job)

Issue #2 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 10 out of 10 builds
	projectroot.benchmark_string_conversions
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)

Issue #3 in nightly_win_deb
- Failing 71.43% in 10 out of 14 builds
	demo_nodes_cpp.TestExecutablesTutorial.test_processes_output
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_debug" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)

Issue #4 in nightly_win_deb
- Failing 64.29% in 9 out of 14 builds
	sros2.test.sros2.commands.security.verbs.test_generate_policy_no_nodes.test_generate_policy_no_nodes
	  (also in: "nightly_win_rel" job)

Issue #5 in nightly_win_rep
- Failing 42.86% in 6 out of 14 builds
	test_rclcpp.test_timeout_subscriber.timeout_subscriber

Issue #6 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	projectroot.test_lifecycle_service_client (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)

Issue #7 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclcpp.TestExecutors/StaticSingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/SingleThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some_max_duration
	rclcpp.TestExecutors/MultiThreadedExecutor.spin_some (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #8 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
	  (also in: "nightly_win_rep" job)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #9 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclpy.rclpy.test.test_guard_condition.TestGuardCondition.test_double_trigger (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	rclcpp_lifecycle.TestLifecycleServiceClientRCLErrors.call_services_rcl_errors (known issue in: https://github.com/ros2/rclcpp/issues/2472 - OPEN)
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_some
	rclcpp.TestBusyWaiting/MultiThreadedExecutor.test_spin_all
	projectroot.test_guard_condition (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclpy/issues/1266 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job)

Issue #10 in gz_rendering-ci-main-noble-amd64
- Failing 100.0% in 5 out of 5 builds
	INTEGRATION_load_unload_ogre_gl3plus.test_ran

Issue #11 in Jci__nightly-cyclonedds_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	projectroot.test.rclcpp.test_executors (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Rci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Jci__nightly-cyclonedds_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2502 - OPEN)

Issue #12 in gz_rendering-7-win
- Failing 100.0% in 4 out of 4 builds
	MeshTest.NormalMapWithoutTexCoord
	  (also in: "gz_rendering-main-win" job)
	  (also in: "gz_rendering-8-win" job)
	  (also in: "gz_rendering-7-win" job)

Issue #13 in nightly_win_rep
- Failing 28.57% in 4 out of 14 builds
	rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock
	projectroot.test.rclcpp.test_clock
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #14 in nightly_linux-rhel_repeated
- Failing 18.75% in 3 out of 16 builds
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #15 in nightly_linux-rhel_repeated
- Failing 18.75% in 3 out of 16 builds
	projectroot.test_tf2_geometry_msgs
	projectroot.display_factory_test
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #16 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	test_rclcpp.TestNNodes.test_10_nodes
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #17 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	rclcpp.TestContentFilterSubscription.content_filter_reset
	  (also in: "nightly_win_rel" job)

Issue #18 in nightly_win_rep
- Failing 21.43% in 3 out of 14 builds
	test_rclcpp.TestNNodesAfterShutdown.test_10_nodes
	projectroot.test_n_nodes__rmw_fastrtps_cpp
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #19 in gz_transport-13-win
- Failing 33.33% in 2 out of 6 builds
	playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport8-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-ign-transport11-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)
	  (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED)

Issue #20 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #21 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)

Issue #22 in nightly_win_deb
- Failing 14.29% in 2 out of 14 builds
	sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy
	  (also in: "nightly_win_rep" job)
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #23 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	test_rclcpp.test_time.timer_during_wait

Issue #24 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[2-3]
	  (also in: "nightly_linux-rhel_repeated" job)

Issue #25 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.test_action_client

Issue #26 in nightly_win_rep
- Failing 14.29% in 2 out of 14 builds
	projectroot.gtest_timeout_subscriber__rmw_fastrtps_cpp

Issue #27 in Ici__nightly-debug_ubuntu_jammy_amd64
- Failing 20.0% in 1 out of 5 builds
	launch_testing_ros.test.examples.wait_for_topic_launch_test.wait_for_topic_launch_test (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)
	  (also in: "nightly_linux_iron_coverage" job) (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)
	  (also in: "nightly_linux_humble_coverage" job) (known issue in: https://github.com/ros2/launch_ros/issues/304 - CLOSED)

Issue #28 in gz_sensors-ci-gz-sensors8-jammy-amd64
- Failing 25.0% in 1 out of 4 builds
	BoundingBoxCameraSensor/BoundingBoxCameraSensorTest.BoxesWithBuiltinSDF/ogre2
	<init>.BoundingBoxCameraSensor/BoundingBoxCameraSensorTest
	  (also in: "gz_sensors-ci-main-noble-amd64" job)
	  (also in: "gz_sensors-ci-gz-sensors8-noble-amd64" job)
	  (also in: "gz_sensors-ci-gz-sensors8-jammy-amd64" job)

Issue #29 in gz_sim-ci-ign-gazebo3-focal-amd64
- Failing 25.0% in 1 out of 4 builds
	INTEGRATION_gpu_lidar.test_ran

Issue #30 in gz_sim-ign-gazebo6-win
- Failing 20.0% in 1 out of 5 builds
	INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)
	  (also in: "gz_sim-7-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED)

Issue #31 in gz_sim-main-win
- Failing 20.0% in 1 out of 5 builds
	INTEGRATION_mesh_inertia_calculation.test_ran

Issue #32 in nightly_linux-aarch64_repeated
- Failing 6.67% in 1 out of 15 builds
	projectroot.message_filters_test_latest_time_policy
	message_filters.LatestTimePolicy.Leading

Issue #33 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	rclcpp.TestBusyWaiting/StaticSingleThreadedExecutor.test_spin
	  (also in: "nightly_win_rep" job)

Issue #34 in Hci__nightly-debug_ubuntu_jammy_amd64
- Failing 33.33% in 1 out of 3 builds
	ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)
	  (also in: "Hci__nightly-debug_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/ros2cli/issues/772 - CLOSED)

Issue #35 in nightly_linux-rhel_release
- Failing 6.25% in 1 out of 16 builds
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)

Issue #36 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #37 in nightly_linux_repeated
- Failing 6.25% in 1 out of 16 builds
	projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux-aarch64_repeated" job)

Issue #38 in nightly_win_rep
- Failing 7.14% in 1 out of 14 builds
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[1-3]
	rclcpp.TestExecutors/EventsExecutor.testSpinUntilFutureCompleteWithTimeout
	rcl_action.TestActionClientFixture.test_action_client_is_valid
	projectroot.test_test_lifecycle.py
	lifecycle.TestLifecyclePubSub.test_talker_lifecycle

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
buildfarmer-log Log of issues in the buildfarm
Projects
None yet
Development

No branches or pull requests

1 participant