Skip to content

Benchmarking for the DisplayServer and its spawned application #271

Benchmarking for the DisplayServer and its spawned application

Benchmarking for the DisplayServer and its spawned application #271

This check has been archived and is scheduled for deletion. Learn more about checks retention
GitHub Actions / Test results failed Sep 20, 2023 in 0s

Test results ❌

Tests failed

Report Passed Failed Skipped Time
junit-confined_shell-3.10.xml 20✅ 120s
junit-confined_shell-3.8.xml 20✅ 120s
junit-mir_demo_server-3.10.xml 19✅ 1❌ 120s
junit-mir_demo_server-3.8.xml 20✅ 120s
junit-mir_kiosk-3.10.xml 13✅ 98s
junit-mir_kiosk-3.8.xml 13✅ 97s
junit-mir_test_tools-3.10.xml 20✅ 121s
junit-mir_test_tools-3.8.xml 20✅ 120s
junit-self-3.10.xml 6✅ 10s
junit-ubuntu_frame-3.10.xml 19✅ 113s
junit-ubuntu_frame-3.8.xml 19✅ 113s

✅ junit-confined_shell-3.10.xml

20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 120s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
  ✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
  ✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
  ✅ test_app_can_run[confined_shell-pluma]
  ✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-confined_shell]
  ✅ test_source_and_dest_match[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app0-confined_shell]
  ✅ test_source_and_dest_mismatch[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app2-confined_shell]
  ✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[confined_shell-asciinema]
  ✅ test_active_app[confined_shell-mir-kiosk-neverputt]
  ✅ test_compositor_alone[confined_shell]
  ✅ test_inactive_app[confined_shell-qterminal]
  ✅ test_inactive_app[confined_shell-pluma]
  ✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
  ✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
  ✅ test_server_can_run[confined_shell]

✅ junit-confined_shell-3.8.xml

20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 120s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
  ✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
  ✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
  ✅ test_app_can_run[confined_shell-pluma]
  ✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-confined_shell]
  ✅ test_source_and_dest_match[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app0-confined_shell]
  ✅ test_source_and_dest_mismatch[app1-confined_shell]
  ✅ test_source_and_dest_mismatch[app2-confined_shell]
  ✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[confined_shell-asciinema]
  ✅ test_active_app[confined_shell-mir-kiosk-neverputt]
  ✅ test_compositor_alone[confined_shell]
  ✅ test_inactive_app[confined_shell-qterminal]
  ✅ test_inactive_app[confined_shell-pluma]
  ✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
  ✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
  ✅ test_server_can_run[confined_shell]

❌ junit-mir_demo_server-3.10.xml

20 tests were completed in 120s with 19 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 19✅ 1❌ 120s

❌ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_demo_server-pluma]
  ❌ test_app_can_run[mir_demo_server-qterminal]
	self = <mir_ci.test_apps_can_run.TestAppsCanRun object at 0x7f16a3cbc610>
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_demo_server]
  ✅ test_source_and_dest_match[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app0-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app2-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_demo_server-asciinema]
  ✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_demo_server]
  ✅ test_inactive_app[mir_demo_server-qterminal]
  ✅ test_inactive_app[mir_demo_server-pluma]
  ✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_demo_server]

✅ junit-mir_demo_server-3.8.xml

20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 120s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_demo_server-pluma]
  ✅ test_app_can_run[mir_demo_server-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_demo_server]
  ✅ test_source_and_dest_match[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app0-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app1-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app2-mir_demo_server]
  ✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_demo_server-asciinema]
  ✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_demo_server]
  ✅ test_inactive_app[mir_demo_server-qterminal]
  ✅ test_inactive_app[mir_demo_server-pluma]
  ✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_demo_server]

✅ junit-mir_kiosk-3.10.xml

13 tests were completed in 98s with 13 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 13✅ 98s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_kiosk-pluma]
  ✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_kiosk-asciinema]
  ✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_kiosk]
  ✅ test_inactive_app[mir_kiosk-qterminal]
  ✅ test_inactive_app[mir_kiosk-pluma]
  ✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_kiosk]

✅ junit-mir_kiosk-3.8.xml

13 tests were completed in 97s with 13 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 13✅ 97s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_kiosk-pluma]
  ✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_kiosk-asciinema]
  ✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_kiosk]
  ✅ test_inactive_app[mir_kiosk-qterminal]
  ✅ test_inactive_app[mir_kiosk-pluma]
  ✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_kiosk]

✅ junit-mir_test_tools-3.10.xml

20 tests were completed in 121s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 121s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_test_tools-pluma]
  ✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_test_tools]
  ✅ test_source_and_dest_match[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app0-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app2-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_test_tools-asciinema]
  ✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_test_tools]
  ✅ test_inactive_app[mir_test_tools-qterminal]
  ✅ test_inactive_app[mir_test_tools-pluma]
  ✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_test_tools]

✅ junit-mir_test_tools-3.8.xml

20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 20✅ 120s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
  ✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_can_run[mir_test_tools-pluma]
  ✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-mir_test_tools]
  ✅ test_source_and_dest_match[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app0-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app1-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app2-mir_test_tools]
  ✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[mir_test_tools-asciinema]
  ✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
  ✅ test_compositor_alone[mir_test_tools]
  ✅ test_inactive_app[mir_test_tools-qterminal]
  ✅ test_inactive_app[mir_test_tools-pluma]
  ✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
  ✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
  ✅ test_server_can_run[mir_test_tools]

✅ junit-self-3.10.xml

6 tests were completed in 10s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 6✅ 10s

✅ pytest

test_tests.TestTest
  ✅ test_project_typechecks
test_tests.TestProgram
  ✅ test_program_gives_output
  ✅ test_program_can_be_waited_for
  ✅ test_program_can_be_terminated
  ✅ test_program_is_killed_when_terminate_fails
  ✅ test_program_command_has_prefix_when_systemd_slice_is_set

✅ junit-ubuntu_frame-3.10.xml

19 tests were completed in 113s with 19 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 19✅ 113s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
  ✅ test_app_can_run[ubuntu_frame-pluma]
  ✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-ubuntu_frame]
  ✅ test_source_and_dest_match[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[ubuntu_frame-asciinema]
  ✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_compositor_alone[ubuntu_frame]
  ✅ test_inactive_app[ubuntu_frame-qterminal]
  ✅ test_inactive_app[ubuntu_frame-pluma]
  ✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[ubuntu_frame]

✅ junit-ubuntu_frame-3.8.xml

19 tests were completed in 113s with 19 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pytest 19✅ 113s

✅ pytest

test_apps_can_run.TestAppsCanRun
  ✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
  ✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
  ✅ test_app_can_run[ubuntu_frame-pluma]
  ✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
  ✅ test_source_and_dest_match[app0-ubuntu_frame]
  ✅ test_source_and_dest_match[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
  ✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
  ✅ test_active_app[ubuntu_frame-asciinema]
  ✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
  ✅ test_compositor_alone[ubuntu_frame]
  ✅ test_inactive_app[ubuntu_frame-qterminal]
  ✅ test_inactive_app[ubuntu_frame-pluma]
  ✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
  ✅ test_server_can_run[ubuntu_frame]

Annotations

Check failure on line 0 in junit-mir_demo_server-3.10.xml

See this annotation in the file changed.

@github-actions github-actions / Test results

pytest ► test_apps_can_run.TestAppsCanRun ► test_app_can_run[mir_demo_server-qterminal]

Failed test found in:
  junit-mir_demo_server-3.10.xml
Error:
  self = <mir_ci.test_apps_can_run.TestAppsCanRun object at 0x7f16a3cbc610>
Raw output
self = <mir_ci.test_apps_can_run.TestAppsCanRun object at 0x7f16a3cbc610>
server = ('mir_demo_server',)
app = <mir_ci.apps.Dependency object at 0x7f16a3c6e920>
record_property = <function record_property.<locals>.append_property at 0x7f16a39f30a0>

    @pytest.mark.smoke
    @pytest.mark.parametrize('app', [
        apps.wpe(),
        apps.snap('mir-kiosk-neverputt'),
        apps.snap('mir-kiosk-scummvm'),
        apps.snap('mir-kiosk-kodi'),
        apps.pluma(),
        apps.qterminal(),
    ])
    async def test_app_can_run(self, server, app, record_property) -> None:
        server_instance = DisplayServer(server)
        program = server_instance.program(app.command, app_type=app.app_type)
        benchmarker = Benchmarker(server_instance, program, poll_time_seconds=0.1)
>       async with benchmarker:

test_apps_can_run.py:24: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
benchmarker.py:79: in __aexit__
    await self.stop()
benchmarker.py:67: in stop
    await program.__aexit__()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <mir_ci.program.Program object at 0x7f16a2864ca0>, args = ()

    async def __aexit__(self, *args) -> None:
        if self.process_end is not None:
>           assert self.is_running(), self.name + ' died without being waited for or killed'
E           AssertionError: qterminal died without being waited for or killed

program.py:137: AssertionError