Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test Scenario not reported #114

Closed
sylvain-viole opened this issue Dec 27, 2021 · 3 comments
Closed

Test Scenario not reported #114

sylvain-viole opened this issue Dec 27, 2021 · 3 comments
Labels
bug Something isn't working

Comments

@sylvain-viole
Copy link

sylvain-viole commented Dec 27, 2021 •
edited
Loading

Describe the bug
On a specific Gherkin test scenario, whatever the result, the test is not reported in the generated allure report

To Reproduce
Hard to reproduce on your side.
100% reproductible on my side

Here is my suite :

On cypress side :
image

On allure side :
image

Scenario #13 = Sign a signature request is missing

Environment (please complete the following information):

  • Cypress version: 8.7.0
  • Cypress Testing library : 8.0.2
  • Cypress allure plugin : 2.22.0
  • OS: Mac (local) and Linux (CI)

** Developer Tools Console Output **

allure-plugin:cy command:end $Command +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:mocha EVENT_TEST_PASS: Sign a signature request Testasync: 0body: "function () {\n      const state = window.testState;\n      return cy\n        .then(() => state.onStartScenario(scenario, indexedSteps))\n        .then(() =>\n          resolveAndRunBeforeHooks.call(this, scenario.tags, state.feature.name)\n        )\n        .then(() =>\n          indexedSteps.forEach((step) =>\n            stepTest.call(this, state, step, rowData)\n          )\n        )\n        .then(() => state.onFinishScenario(scenario));\n    }"callback: ƒ done(err)commands: (157) [{…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, {…}, …]ctx: Context {_runnable: undefined, test: undefined, waitRequest: undefined, table: undefined, field_signer: undefined, …}duration: 24246file: nullfinal: truehooks: []id: "r15"invocationDetails: {function: 'Object.runTest', fileUrl: 'https://yousign.app/__cypress/tests?p=cypress/inte…n/features/signature%2520request/createSR.feature', originalFile: 'node_modules/.pnpm/cypress-cucumber-preprocessor@4…cumber-preprocessor/lib/createTestFromScenario.js', relativeFile: 'node_modules/.pnpm/cypress-cucumber-preprocessor@4…cumber-preprocessor/lib/createTestFromScenario.js', absoluteFile: '/Users/sylvain/repos/v3_e2e/node_modules/.pnpm/cyp…cumber-preprocessor/lib/createTestFromScenario.js', …}order: 13parent: Suite {title: 'Create a Signature Request', ctx: Context, suites: Array(0), tests: Array(14), pending: false, …}pending: falseretries: ƒ (...args)state: "passed"sync: truetimedOut: falsetimer: nulltimings: {lifecycle: 32, before each: Array(2), test: {…}, after each: Array(3)}title: "Sign a signature request"type: "test"wallClockDuration: 24326wallClockStartedAt: Mon Dec 27 2021 19:34:52 GMT+0100 (heure normale d’Europe centrale) {}_condensedHooks: true_currentRetry: 0_enableTimeouts: false_events: {error: ƒ}_eventsCount: 1_fired: {runner:test:before:run: true, runner:test:before:run:async: true, runner:runnable:after:run:async: true, runner:test:after:run: true}_retries: 2_slow: 10000_testConfig: {testConfigList: Array(0), unverifiedTestConfig: {…}}_timeout: 12000[[Prototype]]: Runnable +24s
common.js:113 allure-plugin:cy finished: then Object +4ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +1ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +1ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +1ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +1ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: fillOTPCode Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: mailosaurGetMessageById Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: mailosaurGetMessage Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +1ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +1ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +1ms
common.js:113 allure-plugin:cy finished: then Object +0ms
common.js:113 allure-plugin:cy tracked info about command: Object +0ms
common.js:113 allure-plugin:allure updating test AllureTest to have status:passed and details: undefined +24s
common.js:113 allure-plugin:allure set passed for test: Sign a signature request Test +0ms
common.js:113 allure-plugin:mocha EVENT_TEST_END: Sign a signature request Test +18ms

Additional context

image

image

  • Same behavior with or without Cypress Retry
  • Other scenarios are correctly logged and reported
@sylvain-viole sylvain-viole added the bug Something isn't working label Dec 27, 2021
@sylvain-viole sylvain-viole changed the title Scenario not reported after failure Test Scenario not reported Dec 27, 2021
@sylvain-viole
Copy link
Author

UPDATE

Made some research, turns out allure.testParameter does not throw an error when asked to log a value that is an object

@Shelex Shelex added the in progress tickets are now in progress label Jan 3, 2022
@Shelex
Copy link
Owner

Shelex commented Jan 3, 2022

Hi @sylvain-viole
Thank you for posting an issue and for your investigation.
In case parameter has value of non-primitive type it will throw and error when you will try to generate report.
So will handle this right from plugin to avoid confusion.

Shelex added a commit that referenced this issue Jan 28, 2022
@Shelex
feat: properly handle videoUploadOnPasses #109, remove obsolete proce…
5b42f75 
…ss.env usage #110, add labels for skipped tests #112, throw error for incorrect testParameter #114
@Shelex
Copy link
Owner

Shelex commented Jan 28, 2022

Hi @sylvain-viole
Now handling this case by trowing error, released in v2.24.0

@Shelex Shelex added released and removed in progress tickets are now in progress labels Jan 28, 2022
@Shelex Shelex closed this as completed Feb 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Shelex @sylvain-viole