Skip to content

🧑‍🌾 test_cli_remapping flaky test #511

@Crola1702

Description

@Crola1702

Bug report

Required Info:

  • Operating System:
    • Windows (and sometimes Ubuntu 20.04)
  • Installation type:
    • Source
  • Version or commit hash:
    • Rolling / Foxy

Steps to reproduce issue

  • Run a build in nightly windows or nightly repeated jobs
  • See test_cli_remapping fail if you're lucky

Expected behavior

  • test_cli_remapping should pass

Actual behavior

  • test_cli_remapping is failing sometimes

Additional information

Log output:
Although most of the tests have different names, the log output is very similar in all of them:

Traceback (most recent call last):
  File "C:\ci\ws\src\ros2\system_tests\test_cli_remapping\test\test_cli_remapping.py", line 149, in test_topic_and_service_replacement
    self.assertIn(topic_and_service_replacement, self.get_topics())
AssertionError: '/remapped/ts5907_00_20_08' not found in ['/fully/qualified/name', '/ns/s5749_00_20_08/original_node_name/private/name', '/ns/s5749_00_20_08/relative/name', '/original/namespace/node_6563_00_20_08/private/name', '/original/namespace/original_node_name/private/name', '/original/namespace/relative/name', '/parameter_events', '/remapped/t1668_00_20_08', '/rosout']

Reference builds:

Buildfarmer stats

Flakiness ratio in the last 30 days:

  • Job: Fci__nightly-connext_ubuntu_focal_amd64
    • Last 30 builds: 3 builds failed, 10% with error
    • Last 7 builds: 1 builds failed, 14.28% with error
  • Job: nightly_win_rel
    • Last 30 builds: 5 builds failed, 16.66% with error
    • Last 7 builds: 1 builds failed, 14.28% with error
  • Job: nightly_win_rep
    • Last 30 builds: 10 builds failed, 33.33% with error
    • Last 7 builds: 3 builds failed, 42.85% with error

This test has failed on the following jobs:

Job Last time it happened First time it happened
nightly_win_rep 2023-01-16 2022-01-26
Fci__nightly-connext_ubuntu_focal_amd64 2023-01-14 2021-06-05
nightly_linux-rhel_repeated 2022-12-14 2022-02-05
nightly_linux-aarch64_repeated 2022-11-12 2022-02-01
nightly_linux_repeated 2022-11-12 2022-02-13
nightly_win_deb 2022-10-15 2022-10-15
nightly_win_rel 2022-07-10 2022-03-08

They're mostly Repeated and windows jobs

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions