Improve Block Toolbar Semantics/Accessibility #85878
end2end-test.yml
on: pull_request
Matrix: e2e-playwright
Matrix: e2e-puppeteer
Report to GitHub
9s
Annotations
12 errors and 4 notices
[chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts:
test/e2e/specs/site-editor/template-part.spec.js#L408
1) [chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts
Error: expect(received).toBeFocused()
Call log:
- expect.toBeFocused with timeout 5000ms
- waiting for locator('role=button[name="Change level"i]')
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- waiting for locator('role=button[name="Change level"i]')
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
406 | await expect(
407 | page.locator( 'role=button[name="Change level"i]' )
> 408 | ).toBeFocused();
| ^
409 | } );
410 | } );
411 |
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/template-part.spec.js:408:5
|
[chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts:
test/e2e/specs/site-editor/template-part.spec.js#L408
1) [chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBeFocused()
Call log:
- expect.toBeFocused with timeout 5000ms
- waiting for locator('role=button[name="Change level"i]')
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- waiting for locator('role=button[name="Change level"i]')
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
406 | await expect(
407 | page.locator( 'role=button[name="Change level"i]' )
> 408 | ).toBeFocused();
| ^
409 | } );
410 | } );
411 |
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/template-part.spec.js:408:5
|
[chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts:
test/e2e/specs/site-editor/template-part.spec.js#L408
1) [chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBeFocused()
Call log:
- expect.toBeFocused with timeout 5000ms
- waiting for locator('role=button[name="Change level"i]')
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- waiting for locator('role=button[name="Change level"i]')
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
- locator resolved to <button id=":r2h:" type="button" tabindex="-1" data-comm…>…</button>
- unexpected value "not focused"
406 | await expect(
407 | page.locator( 'role=button[name="Change level"i]' )
> 408 | ).toBeFocused();
| ^
409 | } );
410 | } );
411 |
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/template-part.spec.js:408:5
|
[chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block:
test/e2e/specs/site-editor/writing-flow.spec.js#L40
2) [chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block
Error: expect(received).toBeFocused()
Call log:
- expect.toBeFocused with timeout 5000ms
- waiting for getByRole('button', { name: 'Open save panel' })
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- waiting for getByRole('button', { name: 'Open save panel' })
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
38 | name: 'Open save panel',
39 | } );
> 40 | await expect( blockToolbarButton ).toBeFocused();
| ^
41 | } );
42 |
43 | // Check for regressions of https://github.com/WordPress/gutenberg/issues/41811.
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/writing-flow.spec.js:40:38
|
[chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block:
test/e2e/specs/site-editor/writing-flow.spec.js#L40
2) [chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBeFocused()
Call log:
- expect.toBeFocused with timeout 5000ms
- waiting for getByRole('button', { name: 'Open save panel' })
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- waiting for getByRole('button', { name: 'Open save panel' })
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
38 | name: 'Open save panel',
39 | } );
> 40 | await expect( blockToolbarButton ).toBeFocused();
| ^
41 | } );
42 |
43 | // Check for regressions of https://github.com/WordPress/gutenberg/issues/41811.
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/writing-flow.spec.js:40:38
|
[chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block:
test/e2e/specs/site-editor/writing-flow.spec.js#L40
2) [chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toBeFocused()
Call log:
- expect.toBeFocused with timeout 5000ms
- waiting for getByRole('button', { name: 'Open save panel' })
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- waiting for getByRole('button', { name: 'Open save panel' })
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
- locator resolved to <button type="button" aria-expanded="false" class="compo…>Open save panel</button>
- unexpected value "not focused"
38 | name: 'Open save panel',
39 | } );
> 40 | await expect( blockToolbarButton ).toBeFocused();
| ^
41 | } );
42 |
43 | // Check for regressions of https://github.com/WordPress/gutenberg/issues/41811.
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/site-editor/writing-flow.spec.js:40:38
|
Playwright - 3
Process completed with exit code 1.
|
[chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded:
test/e2e/specs/editor/blocks/cover.spec.js#L90
1) [chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded
Error: expect(received).toHaveCSS(expected)
Expected string: "rgb(179, 179, 179)"
Received string: "rgb(255, 255, 255)"
Call log:
- expect.toHaveCSS with timeout 5000ms
- waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background')
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background')
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
88 | const overlay = coverBlock.locator( '.wp-block-cover__background' );
89 |
> 90 | await expect( overlay ).toHaveCSS(
| ^
91 | 'background-color',
92 | 'rgb(179, 179, 179)'
93 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/cover.spec.js:90:27
|
[chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded:
test/e2e/specs/editor/blocks/cover.spec.js#L90
1) [chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toHaveCSS(expected)
Expected string: "rgb(179, 179, 179)"
Received string: "rgb(255, 255, 255)"
Call log:
- expect.toHaveCSS with timeout 5000ms
- waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background')
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background')
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
88 | const overlay = coverBlock.locator( '.wp-block-cover__background' );
89 |
> 90 | await expect( overlay ).toHaveCSS(
| ^
91 | 'background-color',
92 | 'rgb(179, 179, 179)'
93 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/cover.spec.js:90:27
|
[chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded:
test/e2e/specs/editor/blocks/cover.spec.js#L90
1) [chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toHaveCSS(expected)
Expected string: "rgb(179, 179, 179)"
Received string: "rgb(255, 255, 255)"
Call log:
- expect.toHaveCSS with timeout 5000ms
- waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background')
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- waiting for frameLocator('[name="editor-canvas"]').getByRole('document', { name: 'Block: Cover' }).locator('.wp-block-cover__background')
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
- locator resolved to <span aria-hidden="true" class="wp-block-cover__backgr…></span>
- unexpected value "rgb(255, 255, 255)"
88 | const overlay = coverBlock.locator( '.wp-block-cover__background' );
89 |
> 90 | await expect( overlay ).toHaveCSS(
| ^
91 | 'background-color',
92 | 'rgb(179, 179, 179)'
93 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/cover.spec.js:90:27
|
Playwright - 1
Process completed with exit code 1.
|
Report to GitHub
Unable to find an artifact with the name: flaky-tests-report
|
🎭 Playwright Run Summary
2 failed
[chromium] › site-editor/template-part.spec.js:363:2 › Template Part › Keeps focus in place on undo in template parts
[chromium] › site-editor/writing-flow.spec.js:16:2 › Site editor writing flow › allows shift tabbing out of the editor canvas from the first block
1 skipped
218 passed (15.9m)
|
🎭 Playwright Run Summary
247 passed (19.6m)
|
🎭 Playwright Run Summary
2 skipped
230 passed (19.7m)
|
🎭 Playwright Run Summary
1 failed
[chromium] › editor/blocks/cover.spec.js:74:2 › Cover › dims background image down by 50% with the average image color when an image is uploaded
11 skipped
223 passed (20.2m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
failures-artifacts
Expired
|
15.3 MB |
|