Switch performance tests to Playwright #78275
end2end-test.yml
on: pull_request
Matrix: e2e-playwright
Matrix: e2e-puppeteer
Report to GitHub
4m 22s
Annotations
7 errors and 4 notices
[chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes:
test/e2e/specs/editor/blocks/image.spec.js#L789
1) [chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes
Error: expect(received).toHaveAttribute(expected)
Expected pattern: /137f10e9-7271-4293-b5b2-eca860d1b538/
Received string: "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
Call log:
- expect.toHaveAttribute with timeout 5000ms
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c4de72fc-49e3-47f6-9368-86488dea8bfd"
787 | const image = imageBlock.locator( 'role=img' );
788 | await expect( image ).toBeVisible();
> 789 | await expect( image ).toHaveAttribute(
| ^
790 | 'src',
791 | new RegExp( filename )
792 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
|
[chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes:
test/e2e/specs/editor/blocks/image.spec.js#L789
1) [chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toHaveAttribute(expected)
Expected pattern: /0e88e71d-c900-4342-a378-6a226b8c7734/
Received string: "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
Call log:
- expect.toHaveAttribute with timeout 5000ms
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/5b8126cb-9b92-4bb2-a555-66e7f2266877"
787 | const image = imageBlock.locator( 'role=img' );
788 | await expect( image ).toBeVisible();
> 789 | await expect( image ).toHaveAttribute(
| ^
790 | 'src',
791 | new RegExp( filename )
792 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
|
[chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation:
test/e2e/specs/editor/blocks/image.spec.js#L789
2) [chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation
Error: expect(received).toHaveAttribute(expected)
Expected pattern: /7584b1e8-b14a-4117-8d31-571609017621/
Received string: "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
Call log:
- expect.toHaveAttribute with timeout 5000ms
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/7f0bf0cd-f18d-404c-86d3-2423f7744f3f"
787 | const image = imageBlock.locator( 'role=img' );
788 | await expect( image ).toBeVisible();
> 789 | await expect( image ).toHaveAttribute(
| ^
790 | 'src',
791 | new RegExp( filename )
792 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
|
[chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation:
test/e2e/specs/editor/blocks/image.spec.js#L789
2) [chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toHaveAttribute(expected)
Expected pattern: /a0b30bd5-07fa-497a-b15e-0c740a415619/
Received string: "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
Call log:
- expect.toHaveAttribute with timeout 5000ms
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/c156a0da-b078-4c7a-9ec4-4d176a4f4322"
787 | const image = imageBlock.locator( 'role=img' );
788 | await expect( image ).toBeVisible();
> 789 | await expect( image ).toHaveAttribute(
| ^
790 | 'src',
791 | new RegExp( filename )
792 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
|
[chromium] › editor/blocks/image.spec.js:1060:4 › Image - interactivity › tests using uploaded image › Animation Select visibility › Animation selector should appear if Behavior is Lightbox:
test/e2e/specs/editor/blocks/image.spec.js#L789
3) [chromium] › editor/blocks/image.spec.js:1060:4 › Image - interactivity › tests using uploaded image › Animation Select visibility › Animation selector should appear if Behavior is Lightbox
Error: expect(received).toHaveAttribute(expected)
Expected pattern: /59dc92a1-e6e7-4b3e-af84-933092e9eff0/
Received string: "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
Call log:
- expect.toHaveAttribute with timeout 5000ms
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/bdc838be-a708-47da-99fc-632687d5c934"
787 | const image = imageBlock.locator( 'role=img' );
788 | await expect( image ).toBeVisible();
> 789 | await expect( image ).toHaveAttribute(
| ^
790 | 'src',
791 | new RegExp( filename )
792 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
|
[chromium] › editor/blocks/image.spec.js:1127:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should open and focus appropriately using enter key:
test/e2e/specs/editor/blocks/image.spec.js#L789
4) [chromium] › editor/blocks/image.spec.js:1127:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should open and focus appropriately using enter key
Error: expect(received).toHaveAttribute(expected)
Expected pattern: /c0dafcc6-fd82-42e1-9787-fa0eef6f309f/
Received string: "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
Call log:
- expect.toHaveAttribute with timeout 5000ms
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/382217d2-03ad-4f0c-9cf5-8591d8b84155"
787 | const image = imageBlock.locator( 'role=img' );
788 | await expect( image ).toBeVisible();
> 789 | await expect( image ).toHaveAttribute(
| ^
790 | 'src',
791 | new RegExp( filename )
792 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
|
[chromium] › editor/blocks/image.spec.js:1137:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should close and focus appropriately using enter key on close button:
test/e2e/specs/editor/blocks/image.spec.js#L789
5) [chromium] › editor/blocks/image.spec.js:1137:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should close and focus appropriately using enter key on close button
Error: expect(received).toHaveAttribute(expected)
Expected pattern: /bc37559b-6181-4096-bff2-9a69f520638f/
Received string: "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
Call log:
- expect.toHaveAttribute with timeout 5000ms
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- waiting for locator('role=document[name="Block: Image"i]').locator('role=img')
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
- locator resolved to <img alt="This image has an empty alt attribute" src=…/>
- unexpected value "blob:http://localhost:8889/fe35e6d0-19d0-4b40-a07e-5f08d45dbeff"
787 | const image = imageBlock.locator( 'role=img' );
788 | await expect( image ).toBeVisible();
> 789 | await expect( image ).toHaveAttribute(
| ^
790 | 'src',
791 | new RegExp( filename )
792 | );
at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/blocks/image.spec.js:789:26
|
🎭 Playwright Run Summary
179 passed (12.3m)
|
🎭 Playwright Run Summary
2 skipped
164 passed (15.1m)
|
🎭 Playwright Run Summary
151 passed (16.4m)
|
🎭 Playwright Run Summary
5 flaky
[chromium] › editor/blocks/image.spec.js:797:3 › Image - interactivity › tests using uploaded image › should toggle "lightbox" in saved attributes
[chromium] › editor/blocks/image.spec.js:840:4 › Image - interactivity › tests using uploaded image › should open and close the image in a lightbox when using a mouse and dynamically load src › zoom animation
[chromium] › editor/blocks/image.spec.js:1060:4 › Image - interactivity › tests using uploaded image › Animation Select visibility › Animation selector should appear if Behavior is Lightbox
[chromium] › editor/blocks/image.spec.js:1127:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should open and focus appropriately using enter key
[chromium] › editor/blocks/image.spec.js:1137:4 › Image - interactivity › tests using uploaded image › keyboard navigation › should close and focus appropriately using enter key on close button
176 passed (20.9m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
failures-artifacts
Expired
|
24.7 MB |
|
flaky-tests-report
Expired
|
84.3 KB |
|