Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: pass color through in web server commands #24619

Merged
merged 1 commit into from
Aug 5, 2023
Merged

chore: pass color through in web server commands #24619

merged 1 commit into from
Aug 5, 2023

Conversation

pavelfeldman
Copy link
Member

No description provided.

yury-s
yury-s approved these changes Aug 4, 2023
View reviewed changes
tests/library/playwright.config.ts Outdated
reuseExistingServer: !process.env.CI,
env: {
PLAYWRIGHT_GRID_PORT: '3333',
DEBUG: 'pw:grid*',
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why keep it always on?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that's for debugging!

packages/playwright-test/src/plugins/webServerPlugin.ts Outdated
this._reporter!.onStdOut?.('[WebServer] ' + line.toString());
process.stdout.write(line);
if (debugWebServer.enabled || this._options.stdout === 'pipe') {
this._reporter!.onStdErr?.(colors.dim('[WebServer]'));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
this._reporter!.onStdErr?.(colors.dim('[WebServer]'));
this._reporter!.onStdOut?.(colors.dim('[WebServer]'));

@github-actions
Copy link
Contributor

github-actions bot commented Aug 4, 2023

Test results for "tests 1"

1 failed
❌ [playwright-test-windows-latest-node16] › reporter-html.spec.ts:1452:7 › created › labels › filter should update stats

4 interrupted
⚠️ [playwright-test-windows-latest-node16] › global-setup.spec.ts:313:5 › globalSetup should work for auth
⚠️ [playwright-test-windows-latest-node16] › golden.spec.ts:93:5 › should compile with different option combinations
⚠️ [playwright-test-windows-latest-node16] › reporter.spec.ts:169:9 › merged › should work without a file extension
⚠️ [playwright-test-windows-latest-node16] › retry.spec.ts:164:5 › should not retry expected failure

448 passed, 775 skipped
✔️✔️✔️

❌ [playwright-test-windows-latest-node16] › reporter-html.spec.ts:1452:7 › created › labels › filter should update stats 

Error: expect(received).toBe(expected) // Object.is equality

Expected: "Total time: 1243ms"
Received: "Total time: 1.2s"

  1774 |         await expect(page.locator('.chip', { hasText: 'c.test.js' })).toHaveCount(1);
  1775 |
> 1776 |         await flakyButton.click();
       |                                 ^
  1777 |
  1778 |         await expect(searchInput).toHaveValue('@regression @flaky');
  1779 |         await expect(page).toHaveURL(/@regression%20@flaky/);

    at checkTotalDuration (D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1776:33)
    at D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1792:9

Merge workflow run.

@github-actions
Copy link
Contributor

github-actions bot commented Aug 4, 2023

Test results for "tests 1"

41 failed
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:90:5 › should create a server with environment variables
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:120:5 › should default cwd to config directory
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:487:5 › should create multiple servers
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:617:5 › should treat 3XX as available server
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe"
❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:90:5 › should create a server with environment variables
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:120:5 › should default cwd to config directory
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:487:5 › should create multiple servers
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:617:5 › should treat 3XX as available server
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe"
❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:90:5 › should create a server with environment variables
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:120:5 › should default cwd to config directory
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:487:5 › should create multiple servers
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:617:5 › should treat 3XX as available server
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe"
❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready
❌ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:22:5 › should merge trace events
❌ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions
❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:90:5 › should create a server with environment variables
❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:120:5 › should default cwd to config directory
❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory
❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:487:5 › should create multiple servers
❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:617:5 › should treat 3XX as available server
❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe"
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:90:5 › should create a server with environment variables
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:120:5 › should default cwd to config directory
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:487:5 › should create multiple servers
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:617:5 › should treat 3XX as available server
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe"
❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready

7 flaky
⚠️ [chromium-chromium-ubuntu-22.04-node16] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-22.04-node18] › page/page-event-request.spec.ts:130:3 › should report navigation requests and responses handled by service worker with routing
⚠️ [chromium-chromium-ubuntu-22.04-node20] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox-firefox-ubuntu-22.04-node16] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [firefox-firefox-ubuntu-22.04-node16] › page/page-goto.spec.ts:81:3 › should work with Cross-Origin-Opener-Policy
⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events
⚠️ [playwright-test-ubuntu-latest-node18] › ui-mode-trace.spec.ts:22:5 › should merge trace events

25000 passed, 583 skipped
✔️✔️✔️

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:24:5 › should create a server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] error from server"
Received string:    "[WebServer]error from server
listening on port 10506
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server via the baseURL (418ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (1.4s)
"

  77 |   expect(result.passed).toBe(1);
  78 |   expect(result.output).not.toContain('[WebServer] listening');
> 79 |   expect(result.output).toContain('[WebServer] error from server');
     |                         ^
  80 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  81 |
  82 |   const expectedLogMessages = ['globalSetup-status-200', 'globalSetup-teardown-status', 'globalTeardown-status-200'];

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:79:25

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:90:5 › should create a server with environment variables 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10508... +0ms
  pw:webserver Process started +17ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver Waiting 100ms +2ms
[WebServer]error from server
listening on port 10508
[WebServer]listening on port 10508
  pw:webserver WebServer available +102ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (247ms)·
  1 passed (1.0s)
"

  113 |   expect(result.exitCode).toBe(0);
  114 |   expect(result.passed).toBe(1);
> 115 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  116 |   expect(result.output).toContain('[WebServer] error from server');
  117 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  118 | });

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:115:25

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:120:5 › should default cwd to config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../../tests/playwright-test/assets/simple-server.js\" 10510... +0ms
  pw:webserver Process started +10ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +3ms
[WebServer]error from server
listening on port 10510
[WebServer]listening on port 10510
  pw:webserver WebServer available +102ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (104ms)·
  1 passed (722ms)
"

  142 |   expect(result.exitCode).toBe(0);
  143 |   expect(result.passed).toBe(1);
> 144 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  145 |   expect(result.output).toContain('[WebServer] error from server');
  146 | });
  147 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:144:25

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../tests/playwright-test/assets/simple-server.js\" 10512... +0ms
  pw:webserver Process started +9ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +3ms
[WebServer]error from server
listening on port 10512
[WebServer]listening on port 10512
  pw:webserver WebServer available +102ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (62ms)·
  1 passed (516ms)
"

  171 |   expect(result.exitCode).toBe(0);
  172 |   expect(result.passed).toBe(1);
> 173 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  174 |   expect(result.output).toContain('[WebServer] error from server');
  175 | });
  176 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:173:25

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:487:5 › should create multiple servers 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10514/port +0ms
  pw:webserver Error while checking if http://localhost:10514/port is available: connect ECONNREFUSED ::1:10514 +309ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10514... +0ms
  pw:webserver Process started +9ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver HTTP GET: http://localhost:10514/port +0ms
[WebServer]error from server
listening on port 10514
[WebServer]listening on port 10514
  pw:webserver HTTP Status: 200 +308ms
  pw:webserver WebServer available +2ms
  pw:webserver HTTP GET: http://localhost:10515/port +0ms
  pw:webserver Error while checking if http://localhost:10515/port is available: connect ECONNREFUSED ::1:10515 +302ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10515... +0ms
  pw:webserver Process started +6ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver HTTP GET: http://localhost:10515/port +0ms
[WebServer]error from server
listening on port 10515
[WebServer]listening on port 10515
  pw:webserver HTTP Status: 200 +307ms
  pw:webserver WebServer available +0ms
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:4:13 › connect to the server (151ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (736ms)
"

  547 |   expect(result.exitCode).toBe(0);
  548 |   expect(result.passed).toBe(1);
> 549 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  550 |   expect(result.output).toContain('[WebServer] error from server');
  551 |   expect(result.output).toContain('passed');
  552 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:549:25

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:617:5 › should treat 3XX as available server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10518/redirect +0ms
  pw:webserver Error while checking if http://localhost:10518/redirect is available: connect ECONNREFUSED ::1:10518 +309ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10518... +0ms
  pw:webserver Process started +10ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10518/redirect +1ms
[WebServer]error from server
listening on port 10518
[WebServer]listening on port 10518
  pw:webserver HTTP Status: 301 +307ms
  pw:webserver WebServer available +2ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (45ms)·
  1 passed (430ms)
"

  633 |   expect(result.exitCode).toBe(0);
  634 |   expect(result.passed).toBe(1);
> 635 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  636 |   expect(result.output).toContain('[WebServer] error from server');
  637 | });
  638 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:635:25

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe" 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "[WebServer]error from server
listening on port 10520
[WebServer]listening on port 10520·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (43ms)·
  1 passed (428ms)
"

  680 |   expect(result.exitCode).toBe(0);
  681 |   expect(result.passed).toBe(1);
> 682 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  683 |   expect(result.output).toContain('[WebServer] error from server'); // stderr is piped by default
  684 | });
  685 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:682:25

❌ [playwright-test-ubuntu-latest-node16] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] output from server"
Received string:    "output from server
[WebServer]output from server·
%%SEND-SIGINT%%
[WebServer]
%%SEND-SIGINT%%
Error: Process from config.webServer exited early.····
"

  736 |   const result = parseTestRunnerOutput(testProcess.output);
  737 |   expect(result.passed).toBe(0);
> 738 |   expect(result.output).toContain('[WebServer] output from server');
      |                         ^
  739 |   expect(result.output).not.toContain('Timed out waiting 3000ms');
  740 | });
  741 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:738:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:24:5 › should create a server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] error from server"
Received string:    "[WebServer]error from server
listening on port 10504
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server via the baseURL (289ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (1.1s)
"

  77 |   expect(result.passed).toBe(1);
  78 |   expect(result.output).not.toContain('[WebServer] listening');
> 79 |   expect(result.output).toContain('[WebServer] error from server');
     |                         ^
  80 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  81 |
  82 |   const expectedLogMessages = ['globalSetup-status-200', 'globalSetup-teardown-status', 'globalTeardown-status-200'];

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:79:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:90:5 › should create a server with environment variables 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10508... +0ms
  pw:webserver Process started +5ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver Waiting 100ms +2ms
[WebServer]error from server
listening on port 10508
[WebServer]listening on port 10508
  pw:webserver WebServer available +102ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (279ms)·
  1 passed (969ms)
"

  113 |   expect(result.exitCode).toBe(0);
  114 |   expect(result.passed).toBe(1);
> 115 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  116 |   expect(result.output).toContain('[WebServer] error from server');
  117 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  118 | });

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:115:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:120:5 › should default cwd to config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../../tests/playwright-test/assets/simple-server.js\" 10510... +0ms
  pw:webserver Process started +6ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +3ms
[WebServer]error from server
listening on port 10510
[WebServer]listening on port 10510
  pw:webserver WebServer available +101ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (61ms)·
  1 passed (667ms)
"

  142 |   expect(result.exitCode).toBe(0);
  143 |   expect(result.passed).toBe(1);
> 144 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  145 |   expect(result.output).toContain('[WebServer] error from server');
  146 | });
  147 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:144:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../tests/playwright-test/assets/simple-server.js\" 10512... +0ms
  pw:webserver Process started +5ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver Waiting 100ms +2ms
[WebServer]error from server
listening on port 10512
[WebServer]listening on port 10512
  pw:webserver WebServer available +101ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (48ms)·
  1 passed (470ms)
"

  171 |   expect(result.exitCode).toBe(0);
  172 |   expect(result.passed).toBe(1);
> 173 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  174 |   expect(result.output).toContain('[WebServer] error from server');
  175 | });
  176 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:173:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:487:5 › should create multiple servers 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10514/port +0ms
  pw:webserver Error while checking if http://localhost:10514/port is available: connect ECONNREFUSED ::1:10514 +310ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10514... +0ms
  pw:webserver Process started +5ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10514/port +1ms
[WebServer]error from server
listening on port 10514
[WebServer]listening on port 10514
  pw:webserver HTTP Status: 200 +306ms
  pw:webserver WebServer available +1ms
  pw:webserver HTTP GET: http://localhost:10515/port +0ms
  pw:webserver Error while checking if http://localhost:10515/port is available: connect ECONNREFUSED ::1:10515 +302ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10515... +0ms
  pw:webserver Process started +3ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10515/port +0ms
[WebServer]error from server
listening on port 10515
[WebServer]listening on port 10515
  pw:webserver HTTP Status: 200 +305ms
  pw:webserver WebServer available +0ms
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:4:13 › connect to the server (158ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (699ms)
"

  547 |   expect(result.exitCode).toBe(0);
  548 |   expect(result.passed).toBe(1);
> 549 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  550 |   expect(result.output).toContain('[WebServer] error from server');
  551 |   expect(result.output).toContain('passed');
  552 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:549:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:617:5 › should treat 3XX as available server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10518/redirect +0ms
  pw:webserver Error while checking if http://localhost:10518/redirect is available: connect ECONNREFUSED ::1:10518 +309ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10518... +1ms
  pw:webserver Process started +5ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10518/redirect +0ms
[WebServer]error from server
listening on port 10518
[WebServer]listening on port 10518
  pw:webserver HTTP Status: 301 +306ms
  pw:webserver WebServer available +1ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (39ms)·
  1 passed (382ms)
"

  633 |   expect(result.exitCode).toBe(0);
  634 |   expect(result.passed).toBe(1);
> 635 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  636 |   expect(result.output).toContain('[WebServer] error from server');
  637 | });
  638 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:635:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe" 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "[WebServer]error from server
listening on port 10520
[WebServer]listening on port 10520·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (40ms)·
  1 passed (384ms)
"

  680 |   expect(result.exitCode).toBe(0);
  681 |   expect(result.passed).toBe(1);
> 682 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  683 |   expect(result.output).toContain('[WebServer] error from server'); // stderr is piped by default
  684 | });
  685 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:682:25

❌ [playwright-test-ubuntu-latest-node20] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] output from server"
Received string:    "output from server
[WebServer]output from server
[WebServer]
%%SEND-SIGINT%%·
%%SEND-SIGINT%%
Error: Process from config.webServer exited early.····
"

  736 |   const result = parseTestRunnerOutput(testProcess.output);
  737 |   expect(result.passed).toBe(0);
> 738 |   expect(result.output).toContain('[WebServer] output from server');
      |                         ^
  739 |   expect(result.output).not.toContain('Timed out waiting 3000ms');
  740 | });
  741 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:738:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:24:5 › should create a server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] error from server"
Received string:    "[WebServer]error from server
listening on port 10508
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server via the baseURL (399ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (1.6s)
"

  77 |   expect(result.passed).toBe(1);
  78 |   expect(result.output).not.toContain('[WebServer] listening');
> 79 |   expect(result.output).toContain('[WebServer] error from server');
     |                         ^
  80 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  81 |
  82 |   const expectedLogMessages = ['globalSetup-status-200', 'globalSetup-teardown-status', 'globalTeardown-status-200'];

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:79:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:90:5 › should create a server with environment variables 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"/Users/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10510... +0ms
  pw:webserver Process started +11ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +4ms
[WebServer]error from server
[WebServer]listening on port 10510
listening on port 10510
  pw:webserver WebServer available +104ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (382ms)·
  1 passed (1.4s)
"

  113 |   expect(result.exitCode).toBe(0);
  114 |   expect(result.passed).toBe(1);
> 115 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  116 |   expect(result.output).toContain('[WebServer] error from server');
  117 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  118 | });

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:115:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:120:5 › should default cwd to config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../../tests/playwright-test/assets/simple-server.js\" 10512... +0ms
  pw:webserver Process started +10ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver Waiting 100ms +4ms
[WebServer]error from server
listening on port 10512
[WebServer]listening on port 10512
  pw:webserver WebServer available +104ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (49ms)·
  1 passed (584ms)
"

  142 |   expect(result.exitCode).toBe(0);
  143 |   expect(result.passed).toBe(1);
> 144 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  145 |   expect(result.output).toContain('[WebServer] error from server');
  146 | });
  147 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:144:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../tests/playwright-test/assets/simple-server.js\" 10514... +0ms
  pw:webserver Process started +10ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +4ms
[WebServer]error from server
listening on port 10514
[WebServer]listening on port 10514
  pw:webserver WebServer available +105ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (50ms)·
  1 passed (570ms)
"

  171 |   expect(result.exitCode).toBe(0);
  172 |   expect(result.passed).toBe(1);
> 173 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  174 |   expect(result.output).toContain('[WebServer] error from server');
  175 | });
  176 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:173:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:487:5 › should create multiple servers 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10516/port +0ms
  pw:webserver Error while checking if http://localhost:10516/port is available: connect ECONNREFUSED ::1:10516 +313ms
  pw:webserver Starting WebServer process node \"/Users/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10516... +0ms
  pw:webserver Process started +12ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10516/port +1ms
[WebServer]error from server
listening on port 10516
[WebServer]listening on port 10516
  pw:webserver HTTP Status: 200 +313ms
  pw:webserver WebServer available +2ms
  pw:webserver HTTP GET: http://localhost:10517/port +0ms
  pw:webserver Error while checking if http://localhost:10517/port is available: connect ECONNREFUSED ::1:10517 +304ms
  pw:webserver Starting WebServer process node \"/Users/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10517... +1ms
  pw:webserver Process started +4ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver HTTP GET: http://localhost:10517/port +0ms
[WebServer]error from server
listening on port 10517
[WebServer]listening on port 10517
  pw:webserver HTTP Status: 200 +310ms
  pw:webserver WebServer available +1ms
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:4:13 › connect to the server (417ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (1.3s)
"

  547 |   expect(result.exitCode).toBe(0);
  548 |   expect(result.passed).toBe(1);
> 549 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  550 |   expect(result.output).toContain('[WebServer] error from server');
  551 |   expect(result.output).toContain('passed');
  552 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:549:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:617:5 › should treat 3XX as available server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10520/redirect +0ms
  pw:webserver Error while checking if http://localhost:10520/redirect is available: connect ECONNREFUSED ::1:10520 +315ms
  pw:webserver Starting WebServer process node \"/Users/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10520... +0ms
  pw:webserver Process started +9ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver HTTP GET: http://localhost:10520/redirect +1ms
[WebServer]error from server
listening on port 10520
[WebServer]listening on port 10520
  pw:webserver HTTP Status: 301 +312ms
  pw:webserver WebServer available +3ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (40ms)·
  1 passed (538ms)
"

  633 |   expect(result.exitCode).toBe(0);
  634 |   expect(result.passed).toBe(1);
> 635 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  636 |   expect(result.output).toContain('[WebServer] error from server');
  637 | });
  638 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:635:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe" 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "[WebServer]error from server
listening on port 10522
[WebServer]listening on port 10522·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (41ms)·
  1 passed (546ms)
"

  680 |   expect(result.exitCode).toBe(0);
  681 |   expect(result.passed).toBe(1);
> 682 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  683 |   expect(result.output).toContain('[WebServer] error from server'); // stderr is piped by default
  684 | });
  685 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:682:25

❌ [playwright-test-macos-latest-node16] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] output from server"
Received string:    "output from server
[WebServer]output from server·
%%SEND-SIGINT%%
[WebServer]
%%SEND-SIGINT%%
Error: Process from config.webServer exited early.····
"

  736 |   const result = parseTestRunnerOutput(testProcess.output);
  737 |   expect(result.passed).toBe(0);
> 738 |   expect(result.output).toContain('[WebServer] output from server');
      |                         ^
  739 |   expect(result.output).not.toContain('Timed out waiting 3000ms');
  740 | });
  741 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:738:25

❌ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:22:5 › should merge trace events 

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks991ms",
+   "fixture: browser687ms",
+   "fixture: context43ms",
+   "fixture: page211ms",
+   "browserContext.newPage205ms",
+   "page.setContent33ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')81ms",
+   "expect.toBe0ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

Retry 1:

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks880ms",
+   "fixture: browser585ms",
+   "fixture: context25ms",
+   "fixture: page224ms",
+   "browserContext.newPage209ms",
+   "page.setContent71ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')62ms",
+   "expect.toBe0ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

Retry 2:

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks853ms",
+   "fixture: browser589ms",
+   "fixture: context34ms",
+   "fixture: page200ms",
+   "browserContext.newPage195ms",
+   "page.setContent64ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')76ms",
+   "expect.toBe0ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

Retry 3:

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks911ms",
+   "fixture: browser610ms",
+   "fixture: context84ms",
+   "fixture: page170ms",
+   "browserContext.newPage164ms",
+   "page.setContent34ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')92ms",
+   "expect.toBe0ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

❌ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions 

Error: action list

- Expected  -  7
+ Received  + 11

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page\.setContent[\d.]+m?s/,
-   /locator\.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect\.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks871ms",
+   "fixture: browser583ms",
+   "fixture: context51ms",
+   "fixture: page188ms",
+   "browserContext.newPage175ms",
+   "page.setContent34ms",
+   "locator.clickgetByRole('button')81ms",
+   "expect.toBe1ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements


  142 |       listItem,
  143 |       'action list'
> 144 |   ).toHaveText([
      |     ^
  145 |     /Before Hooks[\d.]+m?s/,
  146 |     /page\.setContent[\d.]+m?s/,
  147 |     /locator\.clickgetByRole\('button'\)[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:144:5

Retry 1:

Error: action list

- Expected  -  7
+ Received  + 11

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page\.setContent[\d.]+m?s/,
-   /locator\.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect\.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks894ms",
+   "fixture: browser563ms",
+   "fixture: context33ms",
+   "fixture: page249ms",
+   "browserContext.newPage243ms",
+   "page.setContent30ms",
+   "locator.clickgetByRole('button')81ms",
+   "expect.toBe1ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements


  142 |       listItem,
  143 |       'action list'
> 144 |   ).toHaveText([
      |     ^
  145 |     /Before Hooks[\d.]+m?s/,
  146 |     /page\.setContent[\d.]+m?s/,
  147 |     /locator\.clickgetByRole\('button'\)[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:144:5

Retry 2:

Error: action list

- Expected  -  7
+ Received  + 11

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page\.setContent[\d.]+m?s/,
-   /locator\.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect\.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks840ms",
+   "fixture: browser562ms",
+   "fixture: context35ms",
+   "fixture: page193ms",
+   "browserContext.newPage187ms",
+   "page.setContent92ms",
+   "locator.clickgetByRole('button')85ms",
+   "expect.toBe1ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements


  142 |       listItem,
  143 |       'action list'
> 144 |   ).toHaveText([
      |     ^
  145 |     /Before Hooks[\d.]+m?s/,
  146 |     /page\.setContent[\d.]+m?s/,
  147 |     /locator\.clickgetByRole\('button'\)[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:144:5

Retry 3:

Error: action list

- Expected  -  7
+ Received  + 11

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page\.setContent[\d.]+m?s/,
-   /locator\.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect\.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks847ms",
+   "fixture: browser580ms",
+   "fixture: context39ms",
+   "fixture: page179ms",
+   "browserContext.newPage173ms",
+   "page.setContent73ms",
+   "locator.clickgetByRole('button')73ms",
+   "expect.toBe1ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements


  142 |       listItem,
  143 |       'action list'
> 144 |   ).toHaveText([
      |     ^
  145 |     /Before Hooks[\d.]+m?s/,
  146 |     /page\.setContent[\d.]+m?s/,
  147 |     /locator\.clickgetByRole\('button'\)[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:144:5

❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:24:5 › should create a server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] error from server"
Received string:    "[WebServer]error from server
listening on port 10522
globalSetup-status-200·
Running 1 test using 1 worker·
  ok 1 test.spec.ts:3:11 › connect to the server via the baseURL (395ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (3.1s)
"

  77 |   expect(result.passed).toBe(1);
  78 |   expect(result.output).not.toContain('[WebServer] listening');
> 79 |   expect(result.output).toContain('[WebServer] error from server');
     |                         ^
  80 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  81 |
  82 |   const expectedLogMessages = ['globalSetup-status-200', 'globalSetup-teardown-status', 'globalTeardown-status-200'];

    at D:\a\playwright\playwright\tests\playwright-test\web-server.spec.ts:79:25

❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:90:5 › should create a server with environment variables 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"D:\\a\\playwright\\playwright\\tests\\playwright-test\\assets\\simple-server.js\" 10524... +0ms
  pw:webserver Process started +8ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +4ms
[WebServer]error from server
listening on port 10524
[WebServer]listening on port 10524
  pw:webserver WebServer available +159ms·
Running 1 test using 1 worker·
  ok 1 test.spec.ts:3:11 › connect to the server (347ms)·
  1 passed (2.0s)
"

  113 |   expect(result.exitCode).toBe(0);
  114 |   expect(result.passed).toBe(1);
> 115 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  116 |   expect(result.output).toContain('[WebServer] error from server');
  117 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  118 | });

    at D:\a\playwright\playwright\tests\playwright-test\web-server.spec.ts:115:25

❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:120:5 › should default cwd to config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"..\\..\\..\\tests\\playwright-test\\assets\\simple-server.js\" 10526... +0ms
  pw:webserver Process started +12ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +3ms
[WebServer]error from server
listening on port 10526
[WebServer]listening on port 10526
  pw:webserver WebServer available +111ms·
Running 1 test using 1 worker·
  ok 1 test.spec.ts:3:11 › connect to the server (68ms)·
  1 passed (948ms)
"

  142 |   expect(result.exitCode).toBe(0);
  143 |   expect(result.passed).toBe(1);
> 144 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  145 |   expect(result.output).toContain('[WebServer] error from server');
  146 | });
  147 |

    at D:\a\playwright\playwright\tests\playwright-test\web-server.spec.ts:144:25

❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"..\\..\\tests\\playwright-test\\assets\\simple-server.js\" 10528... +0ms
  pw:webserver Process started +10ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver Waiting 100ms +3ms
[WebServer]error from server
listening on port 10528
[WebServer]listening on port 10528
  pw:webserver WebServer available +104ms·
Running 1 test using 1 worker·
  ok 1 test.spec.ts:3:11 › connect to the server (58ms)·
  1 passed (854ms)
"

  171 |   expect(result.exitCode).toBe(0);
  172 |   expect(result.passed).toBe(1);
> 173 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  174 |   expect(result.output).toContain('[WebServer] error from server');
  175 | });
  176 |

    at D:\a\playwright\playwright\tests\playwright-test\web-server.spec.ts:173:25

❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:487:5 › should create multiple servers 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10530/port +0ms
  pw:webserver Error while checking if http://localhost:10530/port is available: connect ECONNREFUSED ::1:10530 +323ms
  pw:webserver Starting WebServer process node \"D:\\a\\playwright\\playwright\\tests\\playwright-test\\assets\\simple-server.js\" 10530... +1ms
  pw:webserver Process started +9ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10530/port +0ms
[WebServer]error from server
listening on port 10530
[WebServer]listening on port 10530
  pw:webserver HTTP Status: 200 +325ms
  pw:webserver WebServer available +2ms
  pw:webserver HTTP GET: http://localhost:10531/port +0ms
  pw:webserver Error while checking if http://localhost:10531/port is available: connect ECONNREFUSED ::1:10531 +304ms
  pw:webserver Starting WebServer process node \"D:\\a\\playwright\\playwright\\tests\\playwright-test\\assets\\simple-server.js\" 10531... +0ms
  pw:webserver Process started +5ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10531/port +0ms
[WebServer]error from server
listening on port 10531
[WebServer]listening on port 10531
  pw:webserver HTTP Status: 200 +321ms
  pw:webserver WebServer available +1ms
globalSetup-status-200·
Running 1 test using 1 worker·
  ok 1 test.spec.ts:4:13 › connect to the server (322ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (1.7s)
"

  547 |   expect(result.exitCode).toBe(0);
  548 |   expect(result.passed).toBe(1);
> 549 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  550 |   expect(result.output).toContain('[WebServer] error from server');
  551 |   expect(result.output).toContain('passed');
  552 |

    at D:\a\playwright\playwright\tests\playwright-test\web-server.spec.ts:549:25

❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:617:5 › should treat 3XX as available server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10534/redirect +0ms
  pw:webserver Error while checking if http://localhost:10534/redirect is available: connect ECONNREFUSED ::1:10534 +328ms
  pw:webserver Starting WebServer process node \"D:\\a\\playwright\\playwright\\tests\\playwright-test\\assets\\simple-server.js\" 10534... +0ms
  pw:webserver Process started +8ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10534/redirect +1ms
[WebServer]error from server
listening on port 10534
[WebServer]listening on port 10534
  pw:webserver HTTP Status: 301 +310ms
  pw:webserver WebServer available +1ms·
Running 1 test using 1 worker·
  ok 1 test.spec.ts:3:11 › pass (46ms)·
  1 passed (732ms)
"

  633 |   expect(result.exitCode).toBe(0);
  634 |   expect(result.passed).toBe(1);
> 635 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  636 |   expect(result.output).toContain('[WebServer] error from server');
  637 | });
  638 |

    at D:\a\playwright\playwright\tests\playwright-test\web-server.spec.ts:635:25

❌ [playwright-test-windows-latest-node16] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe" 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "[WebServer]error from server
listening on port 10536
[WebServer]listening on port 10536·
Running 1 test using 1 worker·
  ok 1 test.spec.ts:3:11 › pass (30ms)·
  1 passed (710ms)
"

  680 |   expect(result.exitCode).toBe(0);
  681 |   expect(result.passed).toBe(1);
> 682 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  683 |   expect(result.output).toContain('[WebServer] error from server'); // stderr is piped by default
  684 | });
  685 |

    at D:\a\playwright\playwright\tests\playwright-test\web-server.spec.ts:682:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:24:5 › should create a server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] error from server"
Received string:    "[WebServer]error from server
listening on port 10508
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server via the baseURL (354ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (1.4s)
"

  77 |   expect(result.passed).toBe(1);
  78 |   expect(result.output).not.toContain('[WebServer] listening');
> 79 |   expect(result.output).toContain('[WebServer] error from server');
     |                         ^
  80 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  81 |
  82 |   const expectedLogMessages = ['globalSetup-status-200', 'globalSetup-teardown-status', 'globalTeardown-status-200'];

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:79:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:90:5 › should create a server with environment variables 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10510... +0ms
  pw:webserver Process started +12ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +4ms
[WebServer]error from server
listening on port 10510
[WebServer]listening on port 10510
  pw:webserver WebServer available +103ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (365ms)·
  1 passed (1.5s)
"

  113 |   expect(result.exitCode).toBe(0);
  114 |   expect(result.passed).toBe(1);
> 115 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  116 |   expect(result.output).toContain('[WebServer] error from server');
  117 |   expect(result.report.suites[0].specs[0].tests[0].results[0].status).toContain('passed');
  118 | });

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:115:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:120:5 › should default cwd to config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../../tests/playwright-test/assets/simple-server.js\" 10512... +0ms
  pw:webserver Process started +19ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +4ms
[WebServer]error from server
listening on port 10512
[WebServer]listening on port 10512
  pw:webserver WebServer available +102ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (66ms)·
  1 passed (690ms)
"

  142 |   expect(result.exitCode).toBe(0);
  143 |   expect(result.passed).toBe(1);
> 144 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  145 |   expect(result.output).toContain('[WebServer] error from server');
  146 | });
  147 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:144:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:148:5 › should resolve cwd wrt config directory 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver Starting WebServer process node \"../../tests/playwright-test/assets/simple-server.js\" 10514... +0ms
  pw:webserver Process started +12ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver Waiting 100ms +5ms
[WebServer]error from server
listening on port 10514
[WebServer]listening on port 10514
  pw:webserver WebServer available +102ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › connect to the server (73ms)·
  1 passed (645ms)
"

  171 |   expect(result.exitCode).toBe(0);
  172 |   expect(result.passed).toBe(1);
> 173 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  174 |   expect(result.output).toContain('[WebServer] error from server');
  175 | });
  176 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:173:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:487:5 › should create multiple servers 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10516/port +0ms
  pw:webserver Error while checking if http://localhost:10516/port is available: connect ECONNREFUSED ::1:10516 +313ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10516... +0ms
  pw:webserver Process started +12ms
  pw:webserver Waiting for availability... +1ms
  pw:webserver HTTP GET: http://localhost:10516/port +0ms
[WebServer]error from server
listening on port 10516
[WebServer]listening on port 10516
  pw:webserver HTTP Status: 200 +310ms
  pw:webserver WebServer available +3ms
  pw:webserver HTTP GET: http://localhost:10517/port +0ms
  pw:webserver Error while checking if http://localhost:10517/port is available: connect ECONNREFUSED ::1:10517 +303ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10517... +0ms
  pw:webserver Process started +8ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10517/port +0ms
[WebServer]error from server
listening on port 10517
[WebServer]listening on port 10517
  pw:webserver HTTP Status: 200 +308ms
  pw:webserver WebServer available +1ms
globalSetup-status-200·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:4:13 › connect to the server (223ms)
globalSetup-teardown-status-200
globalTeardown-status-200·
  1 passed (965ms)
"

  547 |   expect(result.exitCode).toBe(0);
  548 |   expect(result.passed).toBe(1);
> 549 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  550 |   expect(result.output).toContain('[WebServer] error from server');
  551 |   expect(result.output).toContain('passed');
  552 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:549:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:617:5 › should treat 3XX as available server 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "  pw:webserver HTTP GET: http://localhost:10520/redirect +0ms
  pw:webserver Error while checking if http://localhost:10520/redirect is available: connect ECONNREFUSED ::1:10520 +319ms
  pw:webserver Starting WebServer process node \"/home/runner/work/playwright/playwright/tests/playwright-test/assets/simple-server.js\" 10520... +0ms
  pw:webserver Process started +14ms
  pw:webserver Waiting for availability... +0ms
  pw:webserver HTTP GET: http://localhost:10520/redirect +1ms
[WebServer]error from server
listening on port 10520
[WebServer]listening on port 10520
  pw:webserver HTTP Status: 301 +310ms
  pw:webserver WebServer available +2ms·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (62ms)·
  1 passed (584ms)
"

  633 |   expect(result.exitCode).toBe(0);
  634 |   expect(result.passed).toBe(1);
> 635 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  636 |   expect(result.output).toContain('[WebServer] error from server');
  637 | });
  638 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:635:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:663:5 › should forward stdout when set to "pipe" 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] listening"
Received string:    "[WebServer]error from server
listening on port 10522
[WebServer]listening on port 10522·
Running 1 test using 1 worker·
  ✓  1 test.spec.ts:3:11 › pass (56ms)·
  1 passed (600ms)
"

  680 |   expect(result.exitCode).toBe(0);
  681 |   expect(result.passed).toBe(1);
> 682 |   expect(result.output).toContain('[WebServer] listening');
      |                         ^
  683 |   expect(result.output).toContain('[WebServer] error from server'); // stderr is piped by default
  684 | });
  685 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:682:25

❌ [playwright-test-ubuntu-latest-node18] › web-server.spec.ts:708:5 › should forward stdout when set to "pipe" before server is ready 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "[WebServer] output from server"
Received string:    "output from server·
%%SEND-SIGINT%%
[WebServer]output from server
[WebServer]
%%SEND-SIGINT%%
Error: Process from config.webServer exited early.····
"

  736 |   const result = parseTestRunnerOutput(testProcess.output);
  737 |   expect(result.passed).toBe(0);
> 738 |   expect(result.output).toContain('[WebServer] output from server');
      |                         ^
  739 |   expect(result.output).not.toContain('Timed out waiting 3000ms');
  740 | });
  741 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/web-server.spec.ts:738:25

Merge workflow run.

@github-actions
Copy link
Contributor

github-actions bot commented Aug 5, 2023

Test results for "tests 1"

1 failed
❌ [playwright-test-windows-latest-node16] › expect-poll.spec.ts:158:5 › should support .not predicate

10 flaky
⚠️ [chromium-chromium-ubuntu-22.04-node16] › page/page-event-request.spec.ts:130:3 › should report navigation requests and responses handled by service worker with routing
⚠️ [chromium-chromium-ubuntu-22.04-node18] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-22.04-node20] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [chromium-chromium-ubuntu-22.04-node20] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [chromium-ubuntu-20.04-chromium-tip-of-tree] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events
⚠️ [playwright-test-ubuntu-latest-node18] › ui-mode-test-progress.spec.ts:167:5 › should update tracing network live

25037 passed, 583 skipped
✔️✔️✔️

❌ [playwright-test-windows-latest-node16] › expect-poll.spec.ts:158:5 › should support .not predicate 

Test timeout of 30000ms exceeded.

Merge workflow run.

@pavelfeldman pavelfeldman merged commit 414a4c3 into microsoft:main Aug 5, 2023
27 of 28 checks passed
@mxschmitt mxschmitt mentioned this pull request Aug 16, 2023
Closed
Germandrummer92 pushed a commit to OctoMind-dev/playwright that referenced this pull request Oct 27, 2023
@pavelfeldman @Germandrummer92
chore: pass color through in web server commands (microsoft#24619)
74cb4b2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yury-s yury-s yury-s approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@pavelfeldman @yury-s