build: Fix e2e tests for builds on v0.78 #3866
Annotations
7 errors, 4 warnings, and 1 notice
Merge into HTML Report:
../../../../../work/tests/styleguide.spec.ts#L96
1) [chromium] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-grids-tree
Error: Screenshot comparison failed:
222 pixels (ratio 0.01 of all image pixels) are different.
Expected: /work/tests/styleguide.spec.ts-snapshots/grids-tree-chromium-linux.png
Received: /work/test-results/styleguide-UI-regression-t-c92f4---sample-section-grids-tree-chromium/grids-tree-actual.png
Diff: /work/test-results/styleguide-UI-regression-t-c92f4---sample-section-grids-tree-chromium/grids-tree-diff.png
Call log:
- expect.toHaveScreenshot(grids-tree.png) with timeout 45000ms
- verifying given screenshot expectation
- waiting for locator('#sample-section-grids-tree')
- locator resolved to <div id="sample-section-grids-tree" class="NW91UW_fle…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 222 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#sample-section-grids-tree')
- locator resolved to <div id="sample-section-grids-tree" class="NW91UW_fle…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 222 pixels (ratio 0.01 of all image pixels) are different.
94 | const sampleSection = page.locator(`#${id}`);
95 |
> 96 | await expect(sampleSection).toHaveScreenshot(
| ^
97 | `${id.replace(/^sample-section-/, '')}.png`,
98 | { timeout: 45000 }
99 | );
at /work/tests/styleguide.spec.ts:96:33
|
Merge into HTML Report:
../../../../../work/tests/styleguide.spec.ts#L96
2) [firefox] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-grids-tree
Error: Screenshot comparison failed:
222 pixels (ratio 0.01 of all image pixels) are different.
Expected: /work/tests/styleguide.spec.ts-snapshots/grids-tree-firefox-linux.png
Received: /work/test-results/styleguide-UI-regression-t-c92f4---sample-section-grids-tree-firefox/grids-tree-actual.png
Diff: /work/test-results/styleguide-UI-regression-t-c92f4---sample-section-grids-tree-firefox/grids-tree-diff.png
Call log:
- expect.toHaveScreenshot(grids-tree.png) with timeout 45000ms
- verifying given screenshot expectation
- waiting for locator('#sample-section-grids-tree')
- locator resolved to <div id="sample-section-grids-tree" class="NW91UW_fle…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 222 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#sample-section-grids-tree')
- locator resolved to <div id="sample-section-grids-tree" class="NW91UW_fle…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 222 pixels (ratio 0.01 of all image pixels) are different.
94 | const sampleSection = page.locator(`#${id}`);
95 |
> 96 | await expect(sampleSection).toHaveScreenshot(
| ^
97 | `${id.replace(/^sample-section-/, '')}.png`,
98 | { timeout: 45000 }
99 | );
at /work/tests/styleguide.spec.ts:96:33
|
Merge into HTML Report:
../../../../../work/tests/styleguide.spec.ts#L96
3) [webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-modals
Error: Screenshot comparison failed:
100 pixels (ratio 0.01 of all image pixels) are different.
Expected: /work/tests/styleguide.spec.ts-snapshots/modals-webkit-linux.png
Received: /work/test-results/styleguide-UI-regression-t-965e3-ion---sample-section-modals-webkit/modals-actual.png
Diff: /work/test-results/styleguide-UI-regression-t-965e3-ion---sample-section-modals-webkit/modals-diff.png
Call log:
- expect.toHaveScreenshot(modals.png) with timeout 45000ms
- verifying given screenshot expectation
- waiting for locator('#sample-section-modals')
- locator resolved to <div class="sample-section" id="sample-section-modals">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 100 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#sample-section-modals')
- locator resolved to <div class="sample-section" id="sample-section-modals">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 100 pixels (ratio 0.01 of all image pixels) are different.
94 | const sampleSection = page.locator(`#${id}`);
95 |
> 96 | await expect(sampleSection).toHaveScreenshot(
| ^
97 | `${id.replace(/^sample-section-/, '')}.png`,
98 | { timeout: 45000 }
99 | );
at /work/tests/styleguide.spec.ts:96:33
|
Merge into HTML Report:
../../../../../work/tests/styleguide.spec.ts#L96
4) [webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-navigations
Error: Screenshot comparison failed:
10 pixels (ratio 0.01 of all image pixels) are different.
Expected: /work/tests/styleguide.spec.ts-snapshots/navigations-webkit-linux.png
Received: /work/test-results/styleguide-UI-regression-t-f1d2c--sample-section-navigations-webkit/navigations-actual.png
Diff: /work/test-results/styleguide-UI-regression-t-f1d2c--sample-section-navigations-webkit/navigations-diff.png
Call log:
- expect.toHaveScreenshot(navigations.png) with timeout 45000ms
- verifying given screenshot expectation
- waiting for locator('#sample-section-navigations')
- locator resolved to <div class="sample-section" id="sample-section-naviga…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 10 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#sample-section-navigations')
- locator resolved to <div class="sample-section" id="sample-section-naviga…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 10 pixels (ratio 0.01 of all image pixels) are different.
94 | const sampleSection = page.locator(`#${id}`);
95 |
> 96 | await expect(sampleSection).toHaveScreenshot(
| ^
97 | `${id.replace(/^sample-section-/, '')}.png`,
98 | { timeout: 45000 }
99 | );
at /work/tests/styleguide.spec.ts:96:33
|
Merge into HTML Report:
../../../../../work/tests/styleguide.spec.ts#L96
5) [webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-grids-tree
Error: Screenshot comparison failed:
288 pixels (ratio 0.01 of all image pixels) are different.
Expected: /work/tests/styleguide.spec.ts-snapshots/grids-tree-webkit-linux.png
Received: /work/test-results/styleguide-UI-regression-t-c92f4---sample-section-grids-tree-webkit/grids-tree-actual.png
Diff: /work/test-results/styleguide-UI-regression-t-c92f4---sample-section-grids-tree-webkit/grids-tree-diff.png
Call log:
- expect.toHaveScreenshot(grids-tree.png) with timeout 45000ms
- verifying given screenshot expectation
- waiting for locator('#sample-section-grids-tree')
- locator resolved to <div id="sample-section-grids-tree" class="NW91UW_fle…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 288 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#sample-section-grids-tree')
- locator resolved to <div id="sample-section-grids-tree" class="NW91UW_fle…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 288 pixels (ratio 0.01 of all image pixels) are different.
94 | const sampleSection = page.locator(`#${id}`);
95 |
> 96 | await expect(sampleSection).toHaveScreenshot(
| ^
97 | `${id.replace(/^sample-section-/, '')}.png`,
98 | { timeout: 45000 }
99 | );
at /work/tests/styleguide.spec.ts:96:33
|
Merge into HTML Report:
../../../../../work/tests/styleguide.spec.ts#L96
6) [webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-spectrum-buttons
Error: Screenshot comparison failed:
104 pixels (ratio 0.01 of all image pixels) are different.
Expected: /work/tests/styleguide.spec.ts-snapshots/spectrum-buttons-webkit-linux.png
Received: /work/test-results/styleguide-UI-regression-t-6aea1-le-section-spectrum-buttons-webkit/spectrum-buttons-actual.png
Diff: /work/test-results/styleguide-UI-regression-t-6aea1-le-section-spectrum-buttons-webkit/spectrum-buttons-diff.png
Call log:
- expect.toHaveScreenshot(spectrum-buttons.png) with timeout 45000ms
- verifying given screenshot expectation
- waiting for locator('#sample-section-spectrum-buttons')
- locator resolved to <div class="sample-section" id="sample-section-spectr…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 104 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#sample-section-spectrum-buttons')
- locator resolved to <div class="sample-section" id="sample-section-spectr…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 104 pixels (ratio 0.01 of all image pixels) are different.
94 | const sampleSection = page.locator(`#${id}`);
95 |
> 96 | await expect(sampleSection).toHaveScreenshot(
| ^
97 | `${id.replace(/^sample-section-/, '')}.png`,
98 | { timeout: 45000 }
99 | );
at /work/tests/styleguide.spec.ts:96:33
|
Merge into HTML Report:
../../../../../work/tests/styleguide.spec.ts#L190
7) [webkit] › styleguide.spec.ts:163:5 › Inputs regression test ──────────────────────────────────
Error: Screenshot comparison failed:
204 pixels (ratio 0.01 of all image pixels) are different.
Expected: /work/tests/styleguide.spec.ts-snapshots/inputs-focus-col3-row7-text-webkit-linux.png
Received: /work/test-results/styleguide-Inputs-regression-test-webkit/inputs-focus-col3-row7-text-actual.png
Diff: /work/test-results/styleguide-Inputs-regression-test-webkit/inputs-focus-col3-row7-text-diff.png
Call log:
- expect.toHaveScreenshot(inputs-focus-col3-row7-text.png) with timeout 15000ms
- verifying given screenshot expectation
- waiting for locator('#sample-section-inputs .col').nth(3)
- locator resolved to <div class="col">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 204 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#sample-section-inputs .col').nth(3)
- locator resolved to <div class="col">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 204 pixels (ratio 0.01 of all image pixels) are different.
188 | await input.focus();
189 |
> 190 | await expect(column).toHaveScreenshot(
| ^
191 | `inputs-focus-col${i}-row${j}-${label}${
192 | isDisabled ? '-disabled' : ''
193 | }.png`
at /work/tests/styleguide.spec.ts:190:28
|
Merge into HTML Report:
[webkit] › golden-layout.spec.ts#L1
[webkit] › golden-layout.spec.ts took 30.5s
|
Merge into HTML Report:
[webkit] › notebook.spec.ts#L1
[webkit] › notebook.spec.ts took 24.0s
|
Merge into HTML Report:
[webkit] › figure.spec.ts#L1
[webkit] › figure.spec.ts took 18.9s
|
Merge into HTML Report:
[webkit] › lazy-loading.spec.ts#L1
[webkit] › lazy-loading.spec.ts took 17.1s
|
Merge into HTML Report
7 failed
[chromium] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-grids-tree
[firefox] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-grids-tree
[webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-modals
[webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-navigations
[webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-grids-tree
[webkit] › styleguide.spec.ts:83:7 › UI regression test - Styleguide section - sample-section-spectrum-buttons
[webkit] › styleguide.spec.ts:163:5 › Inputs regression test ───────────────────────────────────
287 passed (8.1m)
|
Loading