1) [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot Error: expect(locator).toHaveScreenshot(expected) 184 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 184 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 184 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

1) [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 184 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry1/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 184 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 184 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

1) [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 184 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/preferences-user-settings-tab.spec.ts/Preferences-user-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-preferences-user--463e4-should-be-rendered-properly-Chrome-retry2/Preferences-user-settings--45d12--be-rendered-properly-1-diff.png Call log: - expect.toHaveScreenshot(Preferences-user-settings-tab-should-be-rendered-properly-1.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 184 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 184 pixels (ratio 0.01 of all image pixels) are different. 29 | // Assert that the top heading is rendered 30 | await expect(tab.getByRole("heading", { name: "Preferences" })).toBeVisible(); > 31 | await expect(tab).toMatchScreenshot("Preferences-user-settings-tab-should-be-rendered-properly-1.png"); | ^ 32 | }); 33 | 34 | test("should be able to change the app language", async ({ uut, user }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/preferences-user-settings-tab.spec.ts:31:27

Process completed with exit code 1.

1) [Chrome] › audio-player/audio-player.spec.ts:142:9 › Audio player › should be correctly rendered - light theme with monospace font @screenshot Error: expect(received).toBeGreaterThan(expected) Expected: > 0 Received: 0 71 | 72 | // Check the status of the seek bar > 73 | expect(await page.locator(".mx_AudioPlayer_seek input[type='range']").count()).toBeGreaterThan(0); | ^ 74 | 75 | // Enable IRC layout 76 | await app.settings.setValue("layout", null, SettingLevel.DEVICE, Layout.IRC); at takeSnapshots (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:73:88) at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:148:13

1) [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot Error: expect(locator).toHaveScreenshot(expected) 951 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 951 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 951 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", { tag: "@screenshot" }, async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

1) [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 951 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry1/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry1/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 951 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 951 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", { tag: "@screenshot" }, async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

1) [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 951 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry2/account-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-574cd-should-be-rendered-properly-Chrome-retry2/account-diff.png Call log: - expect.toHaveScreenshot(account.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 951 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 951 pixels (ratio 0.01 of all image pixels) are different. 25 | 26 | test("should be rendered properly", { tag: "@screenshot" }, async ({ uut, user }) => { > 27 | await expect(uut).toMatchScreenshot("account.png"); | ^ 28 | 29 | // Assert that the top heading is rendered 30 | await expect(uut.getByRole("heading", { name: "Account", exact: true })).toBeVisible(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:27:27

2) [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot Error: expect(locator).toHaveScreenshot(expected) 139 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 139 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 139 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", { tag: "@screenshot" }, async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

2) [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 139 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry1/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry1/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 139 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 139 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", { tag: "@screenshot" }, async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

2) [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 139 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/account-user-settings-tab.spec.ts/account-smallscreen-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry2/account-smallscreen-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-account-user-sett-b4333-spond-to-small-screen-sizes-Chrome-retry2/account-smallscreen-diff.png Call log: - expect.toHaveScreenshot(account-smallscreen.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 139 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 139 pixels (ratio 0.01 of all image pixels) are different. 74 | test("should respond to small screen sizes", { tag: "@screenshot" }, async ({ page, uut }) => { 75 | await page.setViewportSize({ width: 700, height: 600 }); > 76 | await expect(uut).toMatchScreenshot("account-smallscreen.png"); | ^ 77 | }); 78 | 79 | test("should show tooltips on narrow screen", async ({ page, uut }) => { at /home/runner/work/element-web/element-web/playwright/e2e/settings/account-user-settings-tab.spec.ts:76:27

3) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot Error: expect(locator).toHaveScreenshot(expected) 796 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 796 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 796 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test( at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

3) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 796 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry1/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry1/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 796 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 796 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test( at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

3) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveScreenshot(expected) 796 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry2/appearance-tab-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-92bf7-should-be-rendered-properly-Chrome-retry2/appearance-tab-diff.png Call log: - expect.toHaveScreenshot(appearance-tab.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 796 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 796 pixels (ratio 0.01 of all image pixels) are different. 23 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 24 | > 25 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 26 | }); 27 | 28 | test( at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:25:27

4) [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown @screenshot Error: expect(page).toHaveScreenshot(expected) 541 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts/window-12px-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-Chrome/window-12px-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/settings-appearance-user-s-76af4-sing-the-font-size-dropdown-Chrome/window-12px-diff.png Call log: - expect.toHaveScreenshot(window-12px.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 541 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 541 pixels (ratio 0.01 of all image pixels) are different. 40 | await fontDropdown.getByLabel("Font size").selectOption({ value: "-4" }); 41 | > 42 | await expect(page).toMatchScreenshot("window-12px.png", { includeDialogBackground: true }); | ^ 43 | }, 44 | ); 45 | at /home/runner/work/element-web/element-web/playwright/e2e/settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:42:32

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Test timeout of 90000ms exceeded.

1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Error: page.waitForRequest: Test timeout of 90000ms exceeded. 21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 23 | const tokenApiPromise = page.waitForRequest( | ^ 24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 25 | ); 26 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Stale screenshot file

Process completed with exit code 1.

[Chrome] › timeline/timeline.spec.ts took 2.8m

[Chrome] › threads/threads.spec.ts took 45.2s

[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 36.4s

[Chrome] › widgets/widget-pip-close.spec.ts took 23.1s

[Chrome] › widgets/stickers.spec.ts took 21.9s

[Chrome] › spotlight/spotlight.spec.ts took 2.3m

[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m

[Chrome] › spaces/spaces.spec.ts took 1.1m

[Chrome] › sliding-sync/sliding-sync.spec.ts took 26.6s

[Chrome] › share-dialog/share-dialog.spec.ts took 22.4s

[Chrome] › crypto/event-shields.spec.ts took 1.3m

[Chrome] › knock/knock-into-room.spec.ts took 39.4s

[Chrome] › integration-manager/kick.spec.ts took 39.3s

[Chrome] › editing/editing.spec.ts took 32.2s

[Chrome] › knock/manage-knocks.spec.ts took 30.3s

[Chrome] › composer/RTE.spec.ts took 1.3m

[Chrome] › crypto/crypto.spec.ts took 1.1m

[Chrome] › crypto/device-verification.spec.ts took 46.0s

[Chrome] › crypto/decryption-failure-messages.spec.ts took 41.6s

[Chrome] › accessibility/keyboard-navigation.spec.ts took 31.1s

[Chrome] › right-panel/file-panel.spec.ts took 39.9s

[Chrome] › polls/polls.spec.ts took 35.3s

[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 32.8s

[Chrome] › room/room-header.spec.ts took 28.1s

[Chrome] › register/register.spec.ts took 22.8s

[Chrome] › messages/messages.spec.ts took 2.4m

[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.8m

[Chrome] › login/login.spec.ts took 1.1m

[Chrome] › login/soft_logout.spec.ts took 25.3s

[Chrome] › oidc/oidc-aware.spec.ts took 24.7s

2 skipped 45 passed (6.3m)

1 failed [Chrome] › settings/preferences-user-settings-tab.spec.ts:26:9 › Preferences user settings tab › should be rendered properly @screenshot 10 skipped 43 passed (7.3m)

48 passed (7.5m)

1 flaky [Chrome] › audio-player/audio-player.spec.ts:142:9 › Audio player › should be correctly rendered - light theme with monospace font @screenshot 53 passed (7.7m)

4 failed [Chrome] › settings/account-user-settings-tab.spec.ts:26:9 › Account user settings tab › should be rendered properly @screenshot [Chrome] › settings/account-user-settings-tab.spec.ts:74:9 › Account user settings tab › should respond to small screen sizes @screenshot [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:16:9 › Appearance user settings tab › should be rendered properly @screenshot [Chrome] › settings/appearance-user-settings-tab/appearance-user-settings-tab.spec.ts:28:9 › Appearance user settings tab › should support changing font size by using the font size dropdown @screenshot 1 flaky [Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot 1 skipped 46 passed (8.6m)