Skip to content

Improve Block Toolbar Semantics/Accessibility #85878

Improve Block Toolbar Semantics/Accessibility

Improve Block Toolbar Semantics/Accessibility #85878

Triggered via pull request October 9, 2023 21:09
Status Failure
Total duration 42m 12s
Artifacts 1

end2end-test.yml

on: pull_request
Matrix: e2e-playwright
Matrix: e2e-puppeteer
Report to GitHub
9s
Report to GitHub
Fit to window
Zoom out
Zoom in

Annotations

12 errors and 4 notices
[chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts: test/e2e/specs/site-editor/template-part.spec.js#L408
1) [chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts Error: expect(received).toBeFocused() Call log: - expect.toBeFocused with timeout 5000ms - waiting for locator('role=button[name="Change level"i]') - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - waiting for locator('role=button[name="Change level"i]') - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" 406 | await expect( 407 | page.locator( 'role=button[name="Change level"i]' ) > 408 | ).toBeFocused(); | ^ 409 | } ); 410 | } ); 411 | at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/template-part.spec.js:408:5
[chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts: test/e2e/specs/site-editor/template-part.spec.js#L408
1) [chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeFocused() Call log: - expect.toBeFocused with timeout 5000ms - waiting for locator('role=button[name="Change level"i]') - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - waiting for locator('role=button[name="Change level"i]') - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" 406 | await expect( 407 | page.locator( 'role=button[name="Change level"i]' ) > 408 | ).toBeFocused(); | ^ 409 | } ); 410 | } ); 411 | at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/template-part.spec.js:408:5
[chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts: test/e2e/specs/site-editor/template-part.spec.js#L408
1) [chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeFocused() Call log: - expect.toBeFocused with timeout 5000ms - waiting for locator('role=button[name="Change level"i]') - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - waiting for locator('role=button[name="Change level"i]') - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" - locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button> - unexpected value "not focused" 406 | await expect( 407 | page.locator( 'role=button[name="Change level"i]' ) > 408 | ).toBeFocused(); | ^ 409 | } ); 410 | } ); 411 | at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/template-part.spec.js:408:5
[chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block: test/e2e/specs/site-editor/writing-flow.spec.js#L40
2) [chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block Error: expect(received).toBeFocused() Call log: - expect.toBeFocused with timeout 5000ms - waiting for getByRole('button', { name: 'Open save panel' }) - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - waiting for getByRole('button', { name: 'Open save panel' }) - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" 38 | name: 'Open save panel', 39 | } ); > 40 | await expect( blockToolbarButton ).toBeFocused(); | ^ 41 | } ); 42 | 43 | // Check for regressions of https://github.com/WordPress/gutenberg/issues/41811. at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/writing-flow.spec.js:40:38
[chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block: test/e2e/specs/site-editor/writing-flow.spec.js#L40
2) [chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeFocused() Call log: - expect.toBeFocused with timeout 5000ms - waiting for getByRole('button', { name: 'Open save panel' }) - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - waiting for getByRole('button', { name: 'Open save panel' }) - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" 38 | name: 'Open save panel', 39 | } ); > 40 | await expect( blockToolbarButton ).toBeFocused(); | ^ 41 | } ); 42 | 43 | // Check for regressions of https://github.com/WordPress/gutenberg/issues/41811. at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/writing-flow.spec.js:40:38
[chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block: test/e2e/specs/site-editor/writing-flow.spec.js#L40
2) [chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toBeFocused() Call log: - expect.toBeFocused with timeout 5000ms - waiting for getByRole('button', { name: 'Open save panel' }) - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - waiting for getByRole('button', { name: 'Open save panel' }) - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" - locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button> - unexpected value "not focused" 38 | name: 'Open save panel', 39 | } ); > 40 | await expect( blockToolbarButton ).toBeFocused(); | ^ 41 | } ); 42 | 43 | // Check for regressions of https://github.com/WordPress/gutenberg/issues/41811. at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/writing-flow.spec.js:40:38
Playwright - 3
Process completed with exit code 1.
[chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded: test/e2e/specs/editor/blocks/cover.spec.js#L90
1) [chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded Error: expect(received).toHaveCSS(expected) Expected string: "rgb(179, 179, 179)" Received string: "rgb(255, 255, 255)" Call log: - expect.toHaveCSS with timeout 5000ms - waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background') - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background') - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" 88 | const overlay = coverBlock.locator( '.wp-block-cover__background' ); 89 | > 90 | await expect( overlay ).toHaveCSS( | ^ 91 | 'background-color', 92 | 'rgb(179, 179, 179)' 93 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/cover.spec.js:90:27
[chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded: test/e2e/specs/editor/blocks/cover.spec.js#L90
1) [chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toHaveCSS(expected) Expected string: "rgb(179, 179, 179)" Received string: "rgb(255, 255, 255)" Call log: - expect.toHaveCSS with timeout 5000ms - waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background') - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background') - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" 88 | const overlay = coverBlock.locator( '.wp-block-cover__background' ); 89 | > 90 | await expect( overlay ).toHaveCSS( | ^ 91 | 'background-color', 92 | 'rgb(179, 179, 179)' 93 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/cover.spec.js:90:27
[chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded: test/e2e/specs/editor/blocks/cover.spec.js#L90
1) [chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toHaveCSS(expected) Expected string: "rgb(179, 179, 179)" Received string: "rgb(255, 255, 255)" Call log: - expect.toHaveCSS with timeout 5000ms - waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background') - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background') - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" - locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span> - unexpected value "rgb(255, 255, 255)" 88 | const overlay = coverBlock.locator( '.wp-block-cover__background' ); 89 | > 90 | await expect( overlay ).toHaveCSS( | ^ 91 | 'background-color', 92 | 'rgb(179, 179, 179)' 93 | ); at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/cover.spec.js:90:27
Playwright - 1
Process completed with exit code 1.
Report to GitHub
Unable to find an artifact with the name: flaky-tests-report
🎭 Playwright Run Summary
2 failed [chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts [chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block 1 skipped 218 passed (15.9m)
🎭 Playwright Run Summary
247 passed (19.6m)
🎭 Playwright Run Summary
2 skipped 230 passed (19.7m)
🎭 Playwright Run Summary
1 failed [chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded 11 skipped 223 passed (20.2m)

Artifacts

Produced during runtime
Name Size
failures-artifacts Expired
15.3 MB