Benchmarking for the DisplayServer and its spawned application #271
Test results ❌
Report | Passed | Failed | Skipped | Time |
---|---|---|---|---|
junit-confined_shell-3.10.xml | 20✅ | 120s | ||
junit-confined_shell-3.8.xml | 20✅ | 120s | ||
junit-mir_demo_server-3.10.xml | 19✅ | 1❌ | 120s | |
junit-mir_demo_server-3.8.xml | 20✅ | 120s | ||
junit-mir_kiosk-3.10.xml | 13✅ | 98s | ||
junit-mir_kiosk-3.8.xml | 13✅ | 97s | ||
junit-mir_test_tools-3.10.xml | 20✅ | 121s | ||
junit-mir_test_tools-3.8.xml | 20✅ | 120s | ||
junit-self-3.10.xml | 6✅ | 10s | ||
junit-ubuntu_frame-3.10.xml | 19✅ | 113s | ||
junit-ubuntu_frame-3.8.xml | 19✅ | 113s |
✅ junit-confined_shell-3.10.xml
20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 120s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
✅ test_app_can_run[confined_shell-pluma]
✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-confined_shell]
✅ test_source_and_dest_match[app1-confined_shell]
✅ test_source_and_dest_mismatch[app0-confined_shell]
✅ test_source_and_dest_mismatch[app1-confined_shell]
✅ test_source_and_dest_mismatch[app2-confined_shell]
✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[confined_shell-asciinema]
✅ test_active_app[confined_shell-mir-kiosk-neverputt]
✅ test_compositor_alone[confined_shell]
✅ test_inactive_app[confined_shell-qterminal]
✅ test_inactive_app[confined_shell-pluma]
✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
✅ test_server_can_run[confined_shell]
✅ junit-confined_shell-3.8.xml
20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 120s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
✅ test_app_can_run[confined_shell-pluma]
✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-confined_shell]
✅ test_source_and_dest_match[app1-confined_shell]
✅ test_source_and_dest_mismatch[app0-confined_shell]
✅ test_source_and_dest_mismatch[app1-confined_shell]
✅ test_source_and_dest_mismatch[app2-confined_shell]
✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[confined_shell-asciinema]
✅ test_active_app[confined_shell-mir-kiosk-neverputt]
✅ test_compositor_alone[confined_shell]
✅ test_inactive_app[confined_shell-qterminal]
✅ test_inactive_app[confined_shell-pluma]
✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
✅ test_server_can_run[confined_shell]
❌ junit-mir_demo_server-3.10.xml
20 tests were completed in 120s with 19 passed, 1 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 19✅ | 1❌ | 120s |
❌ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
✅ test_app_can_run[mir_demo_server-pluma]
❌ test_app_can_run[mir_demo_server-qterminal]
self = <mir_ci.test_apps_can_run.TestAppsCanRun object at 0x7f16a3cbc610>
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_demo_server]
✅ test_source_and_dest_match[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app0-mir_demo_server]
✅ test_source_and_dest_mismatch[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app2-mir_demo_server]
✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_demo_server-asciinema]
✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_demo_server]
✅ test_inactive_app[mir_demo_server-qterminal]
✅ test_inactive_app[mir_demo_server-pluma]
✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
✅ test_server_can_run[mir_demo_server]
✅ junit-mir_demo_server-3.8.xml
20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 120s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
✅ test_app_can_run[mir_demo_server-pluma]
✅ test_app_can_run[mir_demo_server-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_demo_server]
✅ test_source_and_dest_match[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app0-mir_demo_server]
✅ test_source_and_dest_mismatch[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app2-mir_demo_server]
✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_demo_server-asciinema]
✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_demo_server]
✅ test_inactive_app[mir_demo_server-qterminal]
✅ test_inactive_app[mir_demo_server-pluma]
✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
✅ test_server_can_run[mir_demo_server]
✅ junit-mir_kiosk-3.10.xml
13 tests were completed in 98s with 13 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 13✅ | 98s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
✅ test_app_can_run[mir_kiosk-pluma]
✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_kiosk-asciinema]
✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_kiosk]
✅ test_inactive_app[mir_kiosk-qterminal]
✅ test_inactive_app[mir_kiosk-pluma]
✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[mir_kiosk]
✅ junit-mir_kiosk-3.8.xml
13 tests were completed in 97s with 13 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 13✅ | 97s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
✅ test_app_can_run[mir_kiosk-pluma]
✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_kiosk-asciinema]
✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_kiosk]
✅ test_inactive_app[mir_kiosk-qterminal]
✅ test_inactive_app[mir_kiosk-pluma]
✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[mir_kiosk]
✅ junit-mir_test_tools-3.10.xml
20 tests were completed in 121s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 121s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
✅ test_app_can_run[mir_test_tools-pluma]
✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_test_tools]
✅ test_source_and_dest_match[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app0-mir_test_tools]
✅ test_source_and_dest_mismatch[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app2-mir_test_tools]
✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_test_tools-asciinema]
✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_test_tools]
✅ test_inactive_app[mir_test_tools-qterminal]
✅ test_inactive_app[mir_test_tools-pluma]
✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
✅ test_server_can_run[mir_test_tools]
✅ junit-mir_test_tools-3.8.xml
20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 120s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
✅ test_app_can_run[mir_test_tools-pluma]
✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_test_tools]
✅ test_source_and_dest_match[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app0-mir_test_tools]
✅ test_source_and_dest_mismatch[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app2-mir_test_tools]
✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_test_tools-asciinema]
✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_test_tools]
✅ test_inactive_app[mir_test_tools-qterminal]
✅ test_inactive_app[mir_test_tools-pluma]
✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
✅ test_server_can_run[mir_test_tools]
✅ junit-self-3.10.xml
6 tests were completed in 10s with 6 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 6✅ | 10s |
✅ pytest
test_tests.TestTest
✅ test_project_typechecks
test_tests.TestProgram
✅ test_program_gives_output
✅ test_program_can_be_waited_for
✅ test_program_can_be_terminated
✅ test_program_is_killed_when_terminate_fails
✅ test_program_command_has_prefix_when_systemd_slice_is_set
✅ junit-ubuntu_frame-3.10.xml
19 tests were completed in 113s with 19 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 19✅ | 113s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
✅ test_app_can_run[ubuntu_frame-pluma]
✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-ubuntu_frame]
✅ test_source_and_dest_match[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[ubuntu_frame-asciinema]
✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
✅ test_compositor_alone[ubuntu_frame]
✅ test_inactive_app[ubuntu_frame-qterminal]
✅ test_inactive_app[ubuntu_frame-pluma]
✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[ubuntu_frame]
✅ junit-ubuntu_frame-3.8.xml
19 tests were completed in 113s with 19 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 19✅ | 113s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
✅ test_app_can_run[ubuntu_frame-pluma]
✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-ubuntu_frame]
✅ test_source_and_dest_match[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[ubuntu_frame-asciinema]
✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
✅ test_compositor_alone[ubuntu_frame]
✅ test_inactive_app[ubuntu_frame-qterminal]
✅ test_inactive_app[ubuntu_frame-pluma]
✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[ubuntu_frame]
Annotations
Check failure on line 0 in junit-mir_demo_server-3.10.xml
github-actions / Test results
pytest ► test_apps_can_run.TestAppsCanRun ► test_app_can_run[mir_demo_server-qterminal]
Failed test found in:
junit-mir_demo_server-3.10.xml
Error:
self = <mir_ci.test_apps_can_run.TestAppsCanRun object at 0x7f16a3cbc610>
Raw output
self = <mir_ci.test_apps_can_run.TestAppsCanRun object at 0x7f16a3cbc610>
server = ('mir_demo_server',)
app = <mir_ci.apps.Dependency object at 0x7f16a3c6e920>
record_property = <function record_property.<locals>.append_property at 0x7f16a39f30a0>
@pytest.mark.smoke
@pytest.mark.parametrize('app', [
apps.wpe(),
apps.snap('mir-kiosk-neverputt'),
apps.snap('mir-kiosk-scummvm'),
apps.snap('mir-kiosk-kodi'),
apps.pluma(),
apps.qterminal(),
])
async def test_app_can_run(self, server, app, record_property) -> None:
server_instance = DisplayServer(server)
program = server_instance.program(app.command, app_type=app.app_type)
benchmarker = Benchmarker(server_instance, program, poll_time_seconds=0.1)
> async with benchmarker:
test_apps_can_run.py:24:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
benchmarker.py:79: in __aexit__
await self.stop()
benchmarker.py:67: in stop
await program.__aexit__()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <mir_ci.program.Program object at 0x7f16a2864ca0>, args = ()
async def __aexit__(self, *args) -> None:
if self.process_end is not None:
> assert self.is_running(), self.name + ' died without being waited for or killed'
E AssertionError: qterminal died without being waited for or killed
program.py:137: AssertionError