Skip to content

Benchmarking for the DisplayServer and its spawned application #282

Benchmarking for the DisplayServer and its spawned application

Benchmarking for the DisplayServer and its spawned application #282

This check has been archived and is scheduled for deletion. Learn more about checks retention
GitHub Actions / Test results failed Sep 20, 2023 in 1s

Test results ❌

Tests failed

Report Passed Failed Skipped Time
junit-confined_shell-3.10.xml 20✅ 120s
junit-confined_shell-3.8.xml 20✅ 120s
junit-mir_demo_server-3.10.xml 20✅ 118s
junit-mir_demo_server-3.8.xml 20✅ 126s
junit-mir_kiosk-3.10.xml 12✅ 1❌ 99s
junit-mir_kiosk-3.8.xml 13✅ 98s
junit-mir_test_tools-3.10.xml 20✅ 119s
junit-mir_test_tools-3.8.xml 20✅ 120s
junit-self-3.10.xml 6✅ 13s
junit-ubuntu_frame-3.10.xml 19✅ 107s
junit-ubuntu_frame-3.8.xml 19✅ 113s

✅ junit-confined_shell-3.10.xml

20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 120s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
  ✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
  ✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
  ✅ test_app_can_run[confined_shell-pluma]
  ✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-confined_shell]
  ✅ test_source_and_dest_match[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app0-confined_shell]
  ✅ test_source_and_dest_mismatch[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app2-confined_shell]
  ✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[confined_shell-asciinema]
  ✅ test_active_app[confined_shell-mir-kiosk-neverputt]
  ✅ test_compositor_alone[confined_shell]
  ✅ test_inactive_app[confined_shell-qterminal]
  ✅ test_inactive_app[confined_shell-pluma]
  ✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
  ✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
  ✅ test_server_can_run[confined_shell]

✅ junit-confined_shell-3.8.xml

20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 120s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
  ✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
  ✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
  ✅ test_app_can_run[confined_shell-pluma]
  ✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-confined_shell]
  ✅ test_source_and_dest_match[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app0-confined_shell]
  ✅ test_source_and_dest_mismatch[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app2-confined_shell]
  ✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[confined_shell-asciinema]
  ✅ test_active_app[confined_shell-mir-kiosk-neverputt]
  ✅ test_compositor_alone[confined_shell]
  ✅ test_inactive_app[confined_shell-qterminal]
  ✅ test_inactive_app[confined_shell-pluma]
  ✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
  ✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
  ✅ test_server_can_run[confined_shell]

✅ junit-mir_demo_server-3.10.xml

20 tests were completed in 118s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 118s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_demo_server-pluma]
  ✅ test_app_can_run[mir_demo_server-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_demo_server]
  ✅ test_source_and_dest_match[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app0-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app2-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_demo_server-asciinema]
  ✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_demo_server]
  ✅ test_inactive_app[mir_demo_server-qterminal]
  ✅ test_inactive_app[mir_demo_server-pluma]
  ✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_demo_server]

✅ junit-mir_demo_server-3.8.xml

20 tests were completed in 126s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 126s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_demo_server-pluma]
  ✅ test_app_can_run[mir_demo_server-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_demo_server]
  ✅ test_source_and_dest_match[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app0-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app2-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_demo_server-asciinema]
  ✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_demo_server]
  ✅ test_inactive_app[mir_demo_server-qterminal]
  ✅ test_inactive_app[mir_demo_server-pluma]
  ✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_demo_server]

❌ junit-mir_kiosk-3.10.xml

13 tests were completed in 99s with 12 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 12✅ 1❌ 99s

❌ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_kiosk-pluma]
  ✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ❌ test_active_app[mir_kiosk-asciinema]
	self = <mir_ci.test_screencopy_bandwidth.TestScreencopyBandwidth object at 0x7f7ea3a19d80>
  ✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_kiosk]
  ✅ test_inactive_app[mir_kiosk-qterminal]
  ✅ test_inactive_app[mir_kiosk-pluma]
  ✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_kiosk]

✅ junit-mir_kiosk-3.8.xml

13 tests were completed in 98s with 13 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 13✅ 98s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_kiosk-pluma]
  ✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_kiosk-asciinema]
  ✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_kiosk]
  ✅ test_inactive_app[mir_kiosk-qterminal]
  ✅ test_inactive_app[mir_kiosk-pluma]
  ✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_kiosk]

✅ junit-mir_test_tools-3.10.xml

20 tests were completed in 119s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 119s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_test_tools-pluma]
  ✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_test_tools]
  ✅ test_source_and_dest_match[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app0-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app2-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_test_tools-asciinema]
  ✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_test_tools]
  ✅ test_inactive_app[mir_test_tools-qterminal]
  ✅ test_inactive_app[mir_test_tools-pluma]
  ✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_test_tools]

✅ junit-mir_test_tools-3.8.xml

20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 120s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_test_tools-pluma]
  ✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_test_tools]
  ✅ test_source_and_dest_match[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app0-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app2-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_test_tools-asciinema]
  ✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_test_tools]
  ✅ test_inactive_app[mir_test_tools-qterminal]
  ✅ test_inactive_app[mir_test_tools-pluma]
  ✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_test_tools]

✅ junit-self-3.10.xml

6 tests were completed in 13s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 6✅ 13s

✅ pytest

test_tests.TestTest
  ✅ test_project_typechecks
test_tests.TestProgram
  ✅ test_program_gives_output
  ✅ test_program_can_be_waited_for
  ✅ test_program_can_be_terminated
  ✅ test_program_is_killed_when_terminate_fails
  ✅ test_program_command_has_prefix_when_systemd_slice_is_set

✅ junit-ubuntu_frame-3.10.xml

19 tests were completed in 107s with 19 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 19✅ 107s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
  ✅ test_app_can_run[ubuntu_frame-pluma]
  ✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-ubuntu_frame]
  ✅ test_source_and_dest_match[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[ubuntu_frame-asciinema]
  ✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_compositor_alone[ubuntu_frame]
  ✅ test_inactive_app[ubuntu_frame-qterminal]
  ✅ test_inactive_app[ubuntu_frame-pluma]
  ✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[ubuntu_frame]

✅ junit-ubuntu_frame-3.8.xml

19 tests were completed in 113s with 19 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 19✅ 113s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
  ✅ test_app_can_run[ubuntu_frame-pluma]
  ✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-ubuntu_frame]
  ✅ test_source_and_dest_match[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[ubuntu_frame-asciinema]
  ✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_compositor_alone[ubuntu_frame]
  ✅ test_inactive_app[ubuntu_frame-qterminal]
  ✅ test_inactive_app[ubuntu_frame-pluma]
  ✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[ubuntu_frame]

Annotations

Check failure on line 0 in junit-mir_kiosk-3.10.xml

See this annotation in the file changed.

@github-actions github-actions / Test results

pytest ► test_screencopy_bandwidth.TestScreencopyBandwidth ► test_active_app[mir_kiosk-asciinema]

Failed test found in:
  junit-mir_kiosk-3.10.xml
Error:
  self = <mir_ci.test_screencopy_bandwidth.TestScreencopyBandwidth object at 0x7f7ea3a19d80>
Raw output
self = <mir_ci.test_screencopy_bandwidth.TestScreencopyBandwidth object at 0x7f7ea3a19d80>
record_property = <function record_property.<locals>.append_property at 0x7f7ea3a8f490>
server = <mir_ci.display_server.DisplayServer object at 0x7f7ea3afcbe0>
app = <mir_ci.apps.Dependency object at 0x7f7ea3a18c40>

    @pytest.mark.parametrize('app', [
        apps.qterminal('--execute', f'python3 -m asciinema play {ASCIINEMA_CAST}', pip_pkgs=('asciinema',), id='asciinema', extra=15),
        apps.snap('mir-kiosk-neverputt', extra=False)
    ])
    async def test_active_app(self, record_property, server, app) -> None:
        server = DisplayServer(server, add_extensions=ScreencopyTracker.required_extensions)
        tracker = ScreencopyTracker(server.display_name)
        async with server as s, tracker, s.program(app.command[0]) as p:
            if app.command[1]:
>               await asyncio.wait_for(p.wait(), timeout=app.command[1])

test_screencopy_bandwidth.py:39: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
/opt/hostedtoolcache/Python/3.10.13/x64/lib/python3.10/asyncio/tasks.py:445: in wait_for
    return fut.result()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <mir_ci.program.Program object at 0x7f7ea3afc130>, timeout = 10
term_timeout = 10

    async def wait(self, timeout=default_wait_timeout, term_timeout=default_term_timeout) -> None:
        if self.is_running():
            self.send_signals_task = asyncio.create_task(
                self.send_kill_signals(timeout, term_timeout))
        if self.process_end is not None:
            await self.process_end
            self.process_end = None
            print('\n' + format_output(self.name, self.output))
            assert self.process
            if self.process.returncode != 0:
                message = self.name
                if self.sigkill_sent:
                    message += ' refused to terminate'
                else:
                    message += ' closed with exit code ' + str(self.process.returncode)
>               raise ProgramError(message)
E               mir_ci.program.ProgramError: qterminal closed with exit code -15

program.py:106: ProgramError