Benchmarking for the DisplayServer and its spawned application #282
Test results ❌
Report | Passed | Failed | Skipped | Time |
---|---|---|---|---|
junit-confined_shell-3.10.xml | 20✅ | 120s | ||
junit-confined_shell-3.8.xml | 20✅ | 120s | ||
junit-mir_demo_server-3.10.xml | 20✅ | 118s | ||
junit-mir_demo_server-3.8.xml | 20✅ | 126s | ||
junit-mir_kiosk-3.10.xml | 12✅ | 1❌ | 99s | |
junit-mir_kiosk-3.8.xml | 13✅ | 98s | ||
junit-mir_test_tools-3.10.xml | 20✅ | 119s | ||
junit-mir_test_tools-3.8.xml | 20✅ | 120s | ||
junit-self-3.10.xml | 6✅ | 13s | ||
junit-ubuntu_frame-3.10.xml | 19✅ | 107s | ||
junit-ubuntu_frame-3.8.xml | 19✅ | 113s |
✅ junit-confined_shell-3.10.xml
20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 120s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
✅ test_app_can_run[confined_shell-pluma]
✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-confined_shell]
✅ test_source_and_dest_match[app1-confined_shell]
✅ test_source_and_dest_mismatch[app0-confined_shell]
✅ test_source_and_dest_mismatch[app1-confined_shell]
✅ test_source_and_dest_mismatch[app2-confined_shell]
✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[confined_shell-asciinema]
✅ test_active_app[confined_shell-mir-kiosk-neverputt]
✅ test_compositor_alone[confined_shell]
✅ test_inactive_app[confined_shell-qterminal]
✅ test_inactive_app[confined_shell-pluma]
✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
✅ test_server_can_run[confined_shell]
✅ junit-confined_shell-3.8.xml
20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 120s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[confined_shell-wpe-webkit-mir-kiosk]
✅ test_app_can_run[confined_shell-mir-kiosk-neverputt]
✅ test_app_can_run[confined_shell-mir-kiosk-scummvm]
✅ test_app_can_run[confined_shell-mir-kiosk-kodi]
✅ test_app_can_run[confined_shell-pluma]
✅ test_app_can_run[confined_shell-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-confined_shell]
✅ test_source_and_dest_match[app1-confined_shell]
✅ test_source_and_dest_mismatch[app0-confined_shell]
✅ test_source_and_dest_mismatch[app1-confined_shell]
✅ test_source_and_dest_mismatch[app2-confined_shell]
✅ test_source_and_dest_mismatch[app3-confined_shell]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[confined_shell-asciinema]
✅ test_active_app[confined_shell-mir-kiosk-neverputt]
✅ test_compositor_alone[confined_shell]
✅ test_inactive_app[confined_shell-qterminal]
✅ test_inactive_app[confined_shell-pluma]
✅ test_inactive_app[confined_shell-mir-kiosk-kodi]
✅ test_app_dragged_around[confined_shell]
test_server.TestServerCanRun
✅ test_server_can_run[confined_shell]
✅ junit-mir_demo_server-3.10.xml
20 tests were completed in 118s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 118s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
✅ test_app_can_run[mir_demo_server-pluma]
✅ test_app_can_run[mir_demo_server-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_demo_server]
✅ test_source_and_dest_match[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app0-mir_demo_server]
✅ test_source_and_dest_mismatch[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app2-mir_demo_server]
✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_demo_server-asciinema]
✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_demo_server]
✅ test_inactive_app[mir_demo_server-qterminal]
✅ test_inactive_app[mir_demo_server-pluma]
✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
✅ test_server_can_run[mir_demo_server]
✅ junit-mir_demo_server-3.8.xml
20 tests were completed in 126s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 126s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_demo_server-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_demo_server-mir-kiosk-neverputt]
✅ test_app_can_run[mir_demo_server-mir-kiosk-scummvm]
✅ test_app_can_run[mir_demo_server-mir-kiosk-kodi]
✅ test_app_can_run[mir_demo_server-pluma]
✅ test_app_can_run[mir_demo_server-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_demo_server]
✅ test_source_and_dest_match[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app0-mir_demo_server]
✅ test_source_and_dest_mismatch[app1-mir_demo_server]
✅ test_source_and_dest_mismatch[app2-mir_demo_server]
✅ test_source_and_dest_mismatch[app3-mir_demo_server]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_demo_server-asciinema]
✅ test_active_app[mir_demo_server-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_demo_server]
✅ test_inactive_app[mir_demo_server-qterminal]
✅ test_inactive_app[mir_demo_server-pluma]
✅ test_inactive_app[mir_demo_server-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_demo_server]
test_server.TestServerCanRun
✅ test_server_can_run[mir_demo_server]
❌ junit-mir_kiosk-3.10.xml
13 tests were completed in 99s with 12 passed, 1 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 12✅ | 1❌ | 99s |
❌ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
✅ test_app_can_run[mir_kiosk-pluma]
✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
❌ test_active_app[mir_kiosk-asciinema]
self = <mir_ci.test_screencopy_bandwidth.TestScreencopyBandwidth object at 0x7f7ea3a19d80>
✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_kiosk]
✅ test_inactive_app[mir_kiosk-qterminal]
✅ test_inactive_app[mir_kiosk-pluma]
✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[mir_kiosk]
✅ junit-mir_kiosk-3.8.xml
13 tests were completed in 98s with 13 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 13✅ | 98s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_kiosk-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_kiosk-mir-kiosk-neverputt]
✅ test_app_can_run[mir_kiosk-mir-kiosk-scummvm]
✅ test_app_can_run[mir_kiosk-mir-kiosk-kodi]
✅ test_app_can_run[mir_kiosk-pluma]
✅ test_app_can_run[mir_kiosk-qterminal]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_kiosk-asciinema]
✅ test_active_app[mir_kiosk-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_kiosk]
✅ test_inactive_app[mir_kiosk-qterminal]
✅ test_inactive_app[mir_kiosk-pluma]
✅ test_inactive_app[mir_kiosk-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[mir_kiosk]
✅ junit-mir_test_tools-3.10.xml
20 tests were completed in 119s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 119s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
✅ test_app_can_run[mir_test_tools-pluma]
✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_test_tools]
✅ test_source_and_dest_match[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app0-mir_test_tools]
✅ test_source_and_dest_mismatch[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app2-mir_test_tools]
✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_test_tools-asciinema]
✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_test_tools]
✅ test_inactive_app[mir_test_tools-qterminal]
✅ test_inactive_app[mir_test_tools-pluma]
✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
✅ test_server_can_run[mir_test_tools]
✅ junit-mir_test_tools-3.8.xml
20 tests were completed in 120s with 20 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 20✅ | 120s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[mir_test_tools-wpe-webkit-mir-kiosk]
✅ test_app_can_run[mir_test_tools-mir-kiosk-neverputt]
✅ test_app_can_run[mir_test_tools-mir-kiosk-scummvm]
✅ test_app_can_run[mir_test_tools-mir-kiosk-kodi]
✅ test_app_can_run[mir_test_tools-pluma]
✅ test_app_can_run[mir_test_tools-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-mir_test_tools]
✅ test_source_and_dest_match[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app0-mir_test_tools]
✅ test_source_and_dest_mismatch[app1-mir_test_tools]
✅ test_source_and_dest_mismatch[app2-mir_test_tools]
✅ test_source_and_dest_mismatch[app3-mir_test_tools]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[mir_test_tools-asciinema]
✅ test_active_app[mir_test_tools-mir-kiosk-neverputt]
✅ test_compositor_alone[mir_test_tools]
✅ test_inactive_app[mir_test_tools-qterminal]
✅ test_inactive_app[mir_test_tools-pluma]
✅ test_inactive_app[mir_test_tools-mir-kiosk-kodi]
✅ test_app_dragged_around[mir_test_tools]
test_server.TestServerCanRun
✅ test_server_can_run[mir_test_tools]
✅ junit-self-3.10.xml
6 tests were completed in 13s with 6 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 6✅ | 13s |
✅ pytest
test_tests.TestTest
✅ test_project_typechecks
test_tests.TestProgram
✅ test_program_gives_output
✅ test_program_can_be_waited_for
✅ test_program_can_be_terminated
✅ test_program_is_killed_when_terminate_fails
✅ test_program_command_has_prefix_when_systemd_slice_is_set
✅ junit-ubuntu_frame-3.10.xml
19 tests were completed in 107s with 19 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 19✅ | 107s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
✅ test_app_can_run[ubuntu_frame-pluma]
✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-ubuntu_frame]
✅ test_source_and_dest_match[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[ubuntu_frame-asciinema]
✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
✅ test_compositor_alone[ubuntu_frame]
✅ test_inactive_app[ubuntu_frame-qterminal]
✅ test_inactive_app[ubuntu_frame-pluma]
✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[ubuntu_frame]
✅ junit-ubuntu_frame-3.8.xml
19 tests were completed in 113s with 19 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
pytest | 19✅ | 113s |
✅ pytest
test_apps_can_run.TestAppsCanRun
✅ test_app_can_run[ubuntu_frame-wpe-webkit-mir-kiosk]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-neverputt]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-scummvm]
✅ test_app_can_run[ubuntu_frame-mir-kiosk-kodi]
✅ test_app_can_run[ubuntu_frame-pluma]
✅ test_app_can_run[ubuntu_frame-qterminal]
test_drag_and_drop.TestDragAndDrop
✅ test_source_and_dest_match[app0-ubuntu_frame]
✅ test_source_and_dest_match[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app0-ubuntu_frame]
✅ test_source_and_dest_mismatch[app1-ubuntu_frame]
✅ test_source_and_dest_mismatch[app2-ubuntu_frame]
✅ test_source_and_dest_mismatch[app3-ubuntu_frame]
test_screencopy_bandwidth.TestScreencopyBandwidth
✅ test_active_app[ubuntu_frame-asciinema]
✅ test_active_app[ubuntu_frame-mir-kiosk-neverputt]
✅ test_compositor_alone[ubuntu_frame]
✅ test_inactive_app[ubuntu_frame-qterminal]
✅ test_inactive_app[ubuntu_frame-pluma]
✅ test_inactive_app[ubuntu_frame-mir-kiosk-kodi]
test_server.TestServerCanRun
✅ test_server_can_run[ubuntu_frame]
Annotations
Check failure on line 0 in junit-mir_kiosk-3.10.xml
github-actions / Test results
pytest ► test_screencopy_bandwidth.TestScreencopyBandwidth ► test_active_app[mir_kiosk-asciinema]
Failed test found in:
junit-mir_kiosk-3.10.xml
Error:
self = <mir_ci.test_screencopy_bandwidth.TestScreencopyBandwidth object at 0x7f7ea3a19d80>
Raw output
self = <mir_ci.test_screencopy_bandwidth.TestScreencopyBandwidth object at 0x7f7ea3a19d80>
record_property = <function record_property.<locals>.append_property at 0x7f7ea3a8f490>
server = <mir_ci.display_server.DisplayServer object at 0x7f7ea3afcbe0>
app = <mir_ci.apps.Dependency object at 0x7f7ea3a18c40>
@pytest.mark.parametrize('app', [
apps.qterminal('--execute', f'python3 -m asciinema play {ASCIINEMA_CAST}', pip_pkgs=('asciinema',), id='asciinema', extra=15),
apps.snap('mir-kiosk-neverputt', extra=False)
])
async def test_active_app(self, record_property, server, app) -> None:
server = DisplayServer(server, add_extensions=ScreencopyTracker.required_extensions)
tracker = ScreencopyTracker(server.display_name)
async with server as s, tracker, s.program(app.command[0]) as p:
if app.command[1]:
> await asyncio.wait_for(p.wait(), timeout=app.command[1])
test_screencopy_bandwidth.py:39:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
/opt/hostedtoolcache/Python/3.10.13/x64/lib/python3.10/asyncio/tasks.py:445: in wait_for
return fut.result()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <mir_ci.program.Program object at 0x7f7ea3afc130>, timeout = 10
term_timeout = 10
async def wait(self, timeout=default_wait_timeout, term_timeout=default_term_timeout) -> None:
if self.is_running():
self.send_signals_task = asyncio.create_task(
self.send_kill_signals(timeout, term_timeout))
if self.process_end is not None:
await self.process_end
self.process_end = None
print('\n' + format_output(self.name, self.output))
assert self.process
if self.process.returncode != 0:
message = self.name
if self.sigkill_sent:
message += ' refused to terminate'
else:
message += ' closed with exit code ' + str(self.process.returncode)
> raise ProgramError(message)
E mir_ci.program.ProgramError: qterminal closed with exit code -15
program.py:106: ProgramError