Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Debugger in vs-code does not stop at breakpoint but elsewhere #5380

Open
6 tasks done
bonham opened this issue Mar 13, 2024 · 27 comments
Open
6 tasks done

Debugger in vs-code does not stop at breakpoint but elsewhere #5380

bonham opened this issue Mar 13, 2024 · 27 comments
Labels
help wanted Extra attention is needed

Comments

@bonham
Copy link

bonham commented Mar 13, 2024

Describe the bug

In vanilla project with vue3 + vitest + @testing-library/vue + node 18.18.2 or 20.11.1, setting and debugging breakpoints in vs-code on windows 11 does not work as expected. Debugger stops at wrong location. I am using vue single file components ( aka .vue files )

Seems to be transpiling and/or sourcemap issue.

The issue disappears when removing <style>...</style> section in .vue file

Reproduction

  1. Create any vanilla vue project with simple single file component which contains all sections: template / script / style
  2. Write a test with @testing-library/vue which is testing this component
  3. Set a breakpoint within a .vue file
  4. Run the test and watch where debugger stops
    Result: Debugger stops at wrong line
    Expected: Debugger should stop at correct line

Issue goes away when removing <style>...</style> section in .vue file

Example file SimpleComponent.vue

<template>
  <div>Hi {{ name }}</div>
  <div>Good</div>
</template>
<script setup>
import { ref } from 'vue'
const name = ref("Peter")
console.log("Nothing special") // set breakpoint here
</script>
<style>
.useless {
  color: green;
}
</style>

Example simple.spec.js

import { test } from 'vitest'
import { render } from '@testing-library/vue'
import SimpleComponent from './components/SimpleComponent.vue'

test("Component", () => {
  const renderResult = render(SimpleComponent)
  renderResult.findByText("mymessage")
})

Full example vanilla project to clone and reproduce: https://github.com/bonham/vitest-debug-issue-js

System Info

System:
    OS: Windows 11 10.0.22631
    CPU: (16) x64 AMD Ryzen 7 5700X 8-Core Processor
    Memory: 20.77 GB / 31.93 GB
  Binaries:
    Node: 20.11.1 - C:\Program Files\nodejs\node.EXE
    npm: 10.2.4 - C:\Program Files\nodejs\npm.CMD
  Browsers:
    Edge: Chromium (122.0.2365.80)
    Internet Explorer: 11.0.22621.1
  npmPackages:
    @vitejs/plugin-vue: ^5.0.4 => 5.0.4 
    vite: ^5.1.6 => 5.1.6 
    vitest: ^1.3.1 => 1.3.1

Used Package Manager

npm

Validations

@AriPerkkio
Copy link
Member

Can you test if @vitejs/plugin-vue@4.5.2 works?

This issue has come up before - it's not really Vitest related. I would guess that your breakpoints don't work even when debugging in browser during development.

Related discussions:

@ghiscoding
Copy link
Contributor

ghiscoding commented Mar 18, 2024

This is most often related to bad or missing sourcemaps

@bonham
Copy link
Author

bonham commented Mar 18, 2024

Can you test if @vitejs/plugin-vue@4.5.2 works?

No, it has the same bug.

This issue has come up before - it's not really Vitest related. I would guess that your breakpoints don't work even when debugging in browser during development.

Breakpoints work well in browser. Breakpoints work well starting vite dev server in "Javascript debug terminal". So it's pretty much narrowed down to vitest I'd say.

Related discussions:

* [Coverage issue in vue files when upgraded with version 1.1.3  or 1.2.0 #4991](https://github.com/vitest-dev/vitest/discussions/4991)

^ This is not related to breakpoints

* [How to debug compents while running tests in VS code? #2874](https://github.com/vitest-dev/vitest/discussions/2874)

^ this is describing exactly the same problem.

Source maps are turned on as you can see in my minimalistic example: https://github.com/bonham/vitest-debug-issue-js/blob/main/vite.config.js

@AriPerkkio
Copy link
Member

Breakpoints seem to work fine when using Chrome Dev tools:

vitest-5380.mov

@bonham
Copy link
Author

bonham commented Mar 23, 2024

Hi @AriPerkkio, yes you are right. I tried the same and also for me breakpoint works well. This is a good workaround.
( I never tried debugging this way before: https://vitest.dev/guide/debugging#node-inspector-e-g-chrome-devtools )

Summary:

  • breakpoints work well when using node inspector and chrome devtools
  • breakpoints do not work when running vitest in debug mode within vs-code ( I tested on mac and windows )

Idk, but seems not a vitest issue but maybe a vs-code issue ( vue plugin or whatever .... )

@CreativeTechGuy
Copy link

Not sure if this is helpful or not, but I can reproduce this issue (in the VS Code debugger) without vue at all, just a plain node app. Disabling coverage when a debugger is attached is a workaround but unfortunate.

@bonham
Copy link
Author

bonham commented Mar 27, 2024

Not sure if this is helpful or not, but I can reproduce this issue (in the VS Code debugger) without vue at all, just a plain node app. Disabling coverage when a debugger is attached is a workaround but unfortunate.

with vitest or even without vitest?

@CreativeTechGuy
Copy link

@bonham Oh sorry, yes with vitest.

@CreativeTechGuy
Copy link

I just tested debugging in VS Code with a node app instrumented with istanbul and esbuild and it works fine with breakpoints being where they should be. So I think there's something in vitest specifically that is causing the problem, I don't think that VS Code is the root problem (although maybe a contributing factor).

@AriPerkkio
Copy link
Member

@CreativeTechGuy how can I reproduce this issue? Is it with covearge.provider: 'v8' or covearge.provider: 'istanbul'? Does it work with vitest --inspect-brk?

@CreativeTechGuy
Copy link

@AriPerkkio Sorry for the delay, this is gnarly. I couldn't reproduce it starting from an empty repo, but I started deconstructing my massive repo and I was able to get it down to a few dozen lines total across all files. I've put a ton of information and very detailed steps in the repo README. Let me know if you are able to reproduce. I've been able to reproduce it across two computers (Windows 10 & 11) so far so hopefully you can too.

https://github.com/CreativeTechGuy/vitest-coverage-debugger-issue-repro

@MarvinKubus
Copy link

Hi @AriPerkkio, yes you are right. I tried the same and also for me breakpoint works well. This is a good workaround. ( I never tried debugging this way before: https://vitest.dev/guide/debugging#node-inspector-e-g-chrome-devtools )

Summary:

  • breakpoints work well when using node inspector and chrome devtools
  • breakpoints do not work when running vitest in debug mode within vs-code ( I tested on mac and windows )

Idk, but seems not a vitest issue but maybe a vs-code issue ( vue plugin or whatever .... )

We are experiencing this same problem at the moment and for us the workaround going through the Chrome Devtools is also working, but a lot less convenient to use.

@mummybot
Copy link

We have this issue at our work across multiple VueJS and Nuxt projects. Various developers have spent collective weeks trying to solve to no success.

@AriPerkkio
Copy link
Member

There's some more discussion about VS Code not respecting inline source maps here: #5605. Check the solution at the end and see if it works for you.

@mummybot
Copy link

mummybot commented Jul 26, 2024

Not sure if the solution at the end is quite our problem - they seem to be trying to debug node_modules, where we are failing on our application code. Trying their fix of this.showExternalized didn't fix anything :( Tried it on two separate projects.

@AriPerkkio
Copy link
Member

Issue goes away when removing <style>...</style> section in .vue file

To me this sounds like source mapping issue. As soon as I remove <style> tags from *.vue files, VS code debugger starts to work. It's like if the <style> tag is introducing another transform step that messes up the source maps completely.

Debugging in vs code without style tags works:
vitest-vscode-vue-debug.mp4

But when looking at the source maps they look just fine:

So to summarize:

  • Chrome dev tools work with style tags ✅
  • Chrome dev tools work without style tags ✅
  • VS code works without style tags ✅
  • VS code does not work with style tags ❌

We have quite many issues that are related to VS Code not being able to handle source maps. Does Vue debugging work in VS Code in general, without Vitest?

@AriPerkkio AriPerkkio added help wanted Extra attention is needed and removed pending triage labels Jul 28, 2024
@sheremet-va
Copy link
Member

We have quite many issues that are related to VS Code not being able to handle source maps. Does Vue debugging work in VS Code in general, without Vitest?

By default, Vitest strips all CSS styles. Does debugger work if test.css is enabled?

@rafagsiqueira
Copy link

rafagsiqueira commented Sep 6, 2024

Having the same issue with an angular application. Breakpoints are all messed up when debugging tests. Works perfectly when debugging application ran with ng serve.

@valneras
Copy link

Same issue on my side with Angular+analogjs+Vitest: debugger moves badly on breakpoints, see gif.
vitest-debug-bug
I also followed this doc https://vitest.dev/guide/debugging#intellij-idea but it doesn't work. Same issue in VsCode with vitest plugin.

I created a repo to reproduce this issue: https://github.com/valneras/jest-vs-vitest
Does someone can clone this repo to confirm this issue? is it related to vitest or another dependency (analogjs, angular?)

We blocked the migration on Vitest because of that :(
Thanks.

@AriPerkkio
Copy link
Member

AriPerkkio commented Sep 17, 2024

@valneras there's an open issue on Analog that's related to the plugin's sourcemap issues: analogjs/analog#1211

We blocked the migration on Vitest because of that

So are you able to use some other testing framework with @analogjs/vite-plugin-angular and it works fine?
This isn't reallly issue on Vitest, it's the plugin.

When looking at the source maps of your project, it's clearly visible that they are completely off when @analogjs/vite-plugin-angular is enabled. No wonder why the breakpoints don't work 😄

And when I remove @analogjs/vite-plugin-angular and run the tests, the source maps are fine:

@brandonroberts
Copy link

@AriPerkkio any tips would be welcomed on this one. The sourcemaps work correctly in the browser, so I'm trying to figure out why they are off with Vitest. We disable esbuild so the sourcemaps are produced through Angular's compilation process

@brandonroberts
Copy link

Example of a produced sourcemap with the plugin

I did grab the generated source from using the vite-plugin-inspect package which is loaded in the browser though

app.component.ts

app.component.spec.ts

https://github.com/brandonroberts/analog-vitest-sourcemaps

@AriPerkkio
Copy link
Member

@brandonroberts you can see the broken source maps in https://github.com/valneras/jest-vs-vitest. But its Vite config is not similar as in your reproduction. It's using @analogjs/vite-plugin-angular directly, while your config uses plugin from @analogjs/platform.

I tested the app.component.spec.ts from @valneras's setup in yours, and it works correctly there: https://evanw.github.io/source-map-visualization/#NDgzMgBp...

So @valneras, update your project to match https://github.com/brandonroberts/analog-vitest-sourcemaps and debugger should work just fine.

@brandonroberts
Copy link

I did find that I needed to explicitly disable esbuild in the vite.config.mts also for the breakpoints to be correct

/// <reference types="vitest" />

import angular from '@analogjs/vite-plugin-angular';

import { defineConfig } from 'vite';

// https://vitejs.dev/config/
export default defineConfig(({ mode }) => {
  return {
    esbuild: false, // completely disable esbuild
    plugins: [
      angular(),
      
    ],
    test: {
      globals: true,
      environment: 'jsdom',
      setupFiles: ['src/test-setup.ts'],
      include: ['**/*.spec.ts'],
      reporters: ['default'],
    },
    define: {
      'import.meta.vitest': mode !== 'production',
    },
  };
});

We are disabling esbuild inside the analog vite plugin, but its not getting applied early enough for Vitest to pick it up, as the VitestPlugin is enforced using pre. We can add an additional plugin internally that sets esbuild: false early enough for it to pick it up

@rafagsiqueira
Copy link

@AriPerkkio and @brandonroberts I tried both approaches. With the @analogjs/platform the gutter icons seem to go to the right place, but breakpoints still jump around and debugger stops at the wrong line. When disabling esbuild, as @brandonroberts suggests, Gutter icons are all wrong as well as breakpoints.

@brandonroberts
Copy link

brandonroberts commented Oct 11, 2024

@AriPerkkio and @brandonroberts I tried both approaches. With the @analogjs/platform the gutter icons seem to go to the right place, but breakpoints still jump around and debugger stops at the wrong line. When disabling esbuild, as @brandonroberts suggests, Gutter icons are all wrong as well as breakpoints.

Ok. I see that also. If I use test.server.debug.dumpModules in the vite.config.ts and load it into the sourcemap visualizer, the lines are off there also.

Sample sourcemap from app.component.spec.ts

Oddly enough, if I remove the first line in the file, they line up correctly. Let's continue the discussion here

analogjs/analog#1211

@brandonroberts
Copy link

brandonroberts commented Oct 12, 2024

Just to provide an update on the Analog side, I landed a fix in Analog 1.9.0-beta.12 that uses esbuild to fix the sourcemaps after the files are transformed, which fixes IDE support and coverage reports. Open to recommendations on a better solution, but it solves the issues.

analogjs/analog#1399

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

10 participants