Treesitter not installing grammars with nix

[SymphonySimper]

Treesitter doesn't seem to resepect grammar packages. I tried removing everything and just enabling treesitter. But that did not install any grammar either. Only installing with non-nix method works. I'm using nixvim as homeManager module.

Before I did this flake update. It was working just fine.

Treesitter config

Click me

{ pkgs, ... }:
{
  programs.nixvim = {
    plugins = {
      treesitter = {
        enable = true;
        nixvimInjections = true;
        nixGrammars = true;
        gccPackage = null;
        nodejsPackage = null;
        treesitterPackage = null;
        grammarPackages = with pkgs.vimPlugins.nvim-treesitter.builtGrammars; [
          bash
          lua
          markdown
          nix
          python

          html
          css
          scss
          javascript
          typescript
          svelte

          dockerfile
          json
          toml
          yaml

          vim
          vimdoc
          tmux
          regex

          gitcommit
          gitignore
        ];
        settings = {
          indent.enable = true;
          highlight = {
            enable = true;
            additional_vim_regex_highlighting = false;
          };
        };
      };

      ts-autotag.enable = true;
    };
    extraPlugins = [ pkgs.vimPlugins.ts-comments-nvim ];
    extraConfigLua = "require 'ts-comments'.setup()";
  };
}

:TSInstallInfo

Click me

gosum              [✗] not installed
gotmpl             [✗] not installed
gowork             [✗] not installed
gpg                [✗] not installed
graphql            [✗] not installed
groovy             [✗] not installed
gstlaunch          [✗] not installed
hack               [✗] not installed
hare               [✗] not installed
haskell            [✗] not installed
haskell_persistent [✗] not installed
hcl                [✗] not installed
heex               [✗] not installed
helm               [✗] not installed
hjson              [✗] not installed
hlsl               [✗] not installed
hlsplaylist        [✗] not installed
hocon              [✗] not installed
hoon               [✗] not installed
html               [✗] not installed
htmldjango         [✗] not installed
http               [✗] not installed
hurl               [✗] not installed
hyprlang           [✗] not installed
idl                [✗] not installed
ini                [✗] not installed
inko               [✗] not installed
ispc               [✗] not installed
janet_simple       [✗] not installed
java               [✗] not installed
javascript         [✗] not installed
jq                 [✗] not installed
jsdoc              [✗] not installed
json               [✗] not installed
json5              [✗] not installed
jsonc              [✗] not installed
jsonnet            [✗] not installed
julia              [✗] not installed
just               [✗] not installed
kconfig            [✗] not installed
kdl                [✗] not installed
kotlin             [✗] not installed
koto               [✗] not installed
kusto              [✗] not installed
lalrpop            [✗] not installed
ledger             [✗] not installed
leo                [✗] not installed
linkerscript       [✗] not installed
liquid             [✗] not installed
liquidsoap         [✗] not installed
llvm               [✗] not installed
lua                [✓] installed
luadoc             [✗] not installed
luap               [✗] not installed
luau               [✗] not installed
m68k               [✗] not installed
make               [✗] not installed
markdown           [✓] installed
markdown_inline    [✓] installed
matlab             [✗] not installed
menhir             [✗] not installed
mermaid            [✗] not installed
meson              [✗] not installed
muttrc             [✗] not installed
nasm               [✗] not installed
nginx              [✗] not installed
nickel             [✗] not installed
nim                [✗] not installed
nim_format_string  [✗] not installed
ninja              [✗] not installed
nix                [✗] not installed
norg               [✓] installed
norg_meta          [✓] installed
nqc                [✗] not installed
objc               [✗] not installed
objdump            [✗] not installed
ocaml              [✗] not installed
ocaml_interface    [✗] not installed
odin               [✗] not installed
org                [✗] not installed
pascal             [✗] not installed
passwd             [✗] not installed
pem                [✗] not installed
perl               [✗] not installed
php                [✗] not installed
php_only           [✗] not installed
phpdoc             [✗] not installed
pioasm             [✗] not installed
po                 [✗] not installed
pod                [✗] not installed
poe_filter         [✗] not installed
pony               [✗] not installed
powershell         [✗] not installed
printf             [✗] not installed
prisma             [✗] not installed
problog            [✗] not installed
prolog             [✗] not installed
promql             [✗] not installed
properties         [✗] not installed
proto              [✗] not installed
prql               [✗] not installed
psv                [✗] not installed
pug                [✗] not installed
puppet             [✗] not installed
purescript         [✗] not installed
pymanifest         [✗] not installed
python             [✗] not installed
ql                 [✗] not installed
qmldir             [✗] not installed
qmljs              [✗] not installed
query              [✓] installed
r                  [✗] not installed
racket             [✗] not installed
ralph              [✗] not installed
rasi               [✗] not installed
rbs                [✗] not installed
re2c               [✗] not installed
readline           [✗] not installed
regex              [✗] not installed
rego               [✗] not installed
requirements       [✗] not installed
rescript           [✗] not installed
rnoweb             [✗] not installed
robot              [✗] not installed
robots             [✗] not installed
roc                [✗] not installed
ron                [✗] not installed
rst                [✗] not installed
ruby               [✗] not installed
rust               [✗] not installed
scala              [✗] not installed
scheme             [✗] not installed
scss               [✗] not installed
slang              [✗] not installed
slint              [✗] not installed
smali              [✗] not installed
smithy             [✗] not installed
snakemake          [✗] not installed
solidity           [✗] not installed
soql               [✗] not installed
sosl               [✗] not installed
sourcepawn         [✗] not installed
sparql             [✗] not installed
sql                [✗] not installed
squirrel           [✗] not installed
ssh_config         [✗] not installed
starlark           [✗] not installed
strace             [✗] not installed
styled             [✗] not installed
supercollider      [✗] not installed
surface            [✗] not installed
svelte             [✗] not installed
sxhkdrc            [✗] not installed
systemtap          [✗] not installed
systemverilog      [✗] not installed
t32                [✗] not installed
tablegen           [✗] not installed
tact               [✗] not installed
tcl                [✗] not installed
templ              [✗] not installed
terraform          [✗] not installed
textproto          [✗] not installed
thrift             [✗] not installed
tiger              [✗] not installed
tlaplus            [✗] not installed
tmux               [✗] not installed
todotxt            [✗] not installed
toml               [✗] not installed
tsv                [✗] not installed
tsx                [✗] not installed
turtle             [✗] not installed
twig               [✗] not installed
typescript         [✗] not installed
typespec           [✗] not installed
typoscript         [✗] not installed
typst              [✗] not installed
udev               [✗] not installed
ungrammar          [✗] not installed
usd                [✗] not installed
uxntal             [✗] not installed
v                  [✗] not installed
vala               [✗] not installed
vento              [✗] not installed
verilog            [✗] not installed
vhdl               [✗] not installed
vhs                [✗] not installed
vim                [✓] installed
vimdoc             [✓] installed
vrl                [✗] not installed
vue                [✗] not installed
wgsl               [✗] not installed
wgsl_bevy          [✗] not installed
wing               [✗] not installed
wit                [✗] not installed
xcompose           [✗] not installed
xml                [✗] not installed
yaml               [✗] not installed
yang               [✗] not installed
yuck               [✗] not installed
zathurarc          [✗] not installed
zig                [✗] not installed

:checkhealth

Click me

==============================================================================
conform: require("conform.health").check()

conform.nvim report ~
- Log file: /home/symph/.local/state/nvim/conform.log
- OK codespell ready (*)
- OK nixfmt ready (nix)
- OK prettier ready (typescript, json, html, javascript, css, svelte)
- OK ruff_format ready (python)
- OK shfmt ready (sh)
- OK stylua ready (lua)
- OK trim_whitespace ready (*)

==============================================================================
dressing: require("dressing.health").check()

dressing.nvim ~
- OK vim.ui.input active
- OK vim.ui.select active: telescope

==============================================================================
luasnip: require("luasnip.health").check()

luasnip ~
- OK jsregexp is installed

==============================================================================
neorg: require("neorg.health").check()

Neorg Configuration ~
- Checking `load` table...
- OK Module declaration for `core.concealer` is well-formed
- OK Module declaration for `core.completion` is well-formed
- OK Module declaration for `core.esupports.metagen` is well-formed
- OK Module declaration for `core.defaults` is well-formed
- OK Module declaration for `core.dirman` is well-formed
- OK Module declaration for `core.journal` is well-formed
- OK Default configuration for logger provided, Neorg will not output debug info.

Neorg Dependencies ~
- OK `luarocks` is installed.

Neorg Keybinds ~
- Neorg is configured to use keybind preset `neorg`
- OK No keybind conflicts found.

==============================================================================
noice: require("noice.health").check()

noice.nvim ~
- OK **Neovim** >= 0.9.0
- OK You're using a GUI that should work ok
- OK **vim.go.lazyredraw** is not enabled
- WARNING Noice needs nvim-notify for routes using the `notify` view
- OK **TreeSitter vim** parser is installed
- WARNING **TreeSitter regex** parser is not installed. Highlighting of the cmdline for regex might be broken
- OK **TreeSitter lua** parser is installed
- WARNING **TreeSitter bash** parser is not installed. Highlighting of the cmdline for bash might be broken
- OK **TreeSitter markdown** parser is installed
- OK **TreeSitter markdown_inline** parser is installed
- OK `vim.notify` is set to **Noice**
- OK `vim.lsp.handlers["textDocument/hover"]` is set to **Noice**
- OK `vim.lsp.handlers["textDocument/signatureHelp"]` is set to **Noice**
- OK `vim.lsp.handlers["window/showMessage"]` is set to **Noice**
- OK `vim.lsp.util.convert_input_to_markdown_lines` is set to **Noice**
- OK `vim.lsp.util.stylize_markdown` is set to **Noice**
- OK `cmp.entry.get_documentation` is set to **Noice**

==============================================================================
nvim: require("nvim.health").check()

Configuration ~
- OK no issues found

Runtime ~
- OK $VIMRUNTIME: /nix/store/16vq4y53dkbpk5j2lwvq61ljbi0ldh4v-neovim-byte-compiled-0.10.1/share/nvim/runtime

Performance ~
- OK Build type: Release

Remote Plugins ~
- OK Up to date

terminal ~
- key_backspace (kbs) terminfo entry: `key_backspace=\177`
- key_dc (kdch1) terminfo entry: `key_dc=\E[3~`
- $TERM_PROGRAM="tmux"
- $COLORTERM="truecolor"

tmux ~
- OK escape-time: 0
- OK focus-events: on
- $TERM: tmux-256color

External Tools ~
- OK ripgrep 14.1.0 (/nix/store/mng5a43lc9amknw93ds0ghkrcdwwh3vl-ripgrep-14.1.0/bin/rg)

==============================================================================
nvim-treesitter: require("nvim-treesitter.health").check()

Installation ~
- WARNING `tree-sitter` executable not found (parser generator, only needed for :TSInstallFromGrammar, not required for :TSInstall)
- OK `node` found v20.16.0 (only needed for :TSInstallFromGrammar)
- OK `git` executable found.
- OK `cc` executable found. Selected from { vim.NIL, "cc", "gcc", "clang", "cl", "zig" }
  Version: gcc (GCC) 13.3.0
- OK Neovim was compiled with tree-sitter runtime ABI version 14 (required >=13). Parsers must be compatible with runtime ABI.

OS Info:
{
  machine = "x86_64",
  release = "6.6.49",
  sysname = "Linux",
  version = "#1-NixOS SMP PREEMPT_DYNAMIC Wed Sep  4 11:28:31 UTC 2024"
} ~

Parser/Features         H L F I J
  - c                   ✓ ✓ ✓ ✓ ✓
  - lua                 ✓ ✓ ✓ ✓ ✓
  - markdown            ✓ . ✓ ✓ ✓
  - markdown_inline     ✓ . . . ✓
  - norg                ✓ . ✓ . ✓
  - norg_meta           ✓ . . ✓ .
  - query               ✓ ✓ ✓ ✓ ✓
  - vim                 ✓ ✓ ✓ . ✓
  - vimdoc              ✓ . . . ✓

  Legend: H[ighlight], L[ocals], F[olds], I[ndents], In[j]ections
         +) multiple parsers found, only one will be used
         x) errors found in the query, try to run :TSUpdate {lang} ~

==============================================================================
provider.clipboard: require("provider.clipboard.health").check()

Clipboard (optional) ~
- OK Clipboard tool found: wl-copy

==============================================================================
provider.node: require("provider.node.health").check()

Node.js provider (optional) ~
- Node.js: v20.16.0
  
- Nvim node.js host: /nix/store/p4fyy5y58d48fdp6z2wnnbvsrlc9mdwh-neovim-0.10.1/bin/nvim-node
- OK Latest "neovim" npm/yarn/pnpm package is installed: 5.1.0
  

==============================================================================
provider.perl: require("provider.perl.health").check()

Perl provider (optional) ~
- Disabled (loaded_perl_provider=0).

==============================================================================
provider.python: require("provider.python.health").check()

Python 3 provider (optional) ~
- Using: g:python3_host_prog = "/nix/store/p4fyy5y58d48fdp6z2wnnbvsrlc9mdwh-neovim-0.10.1/bin/nvim-python3"
- Executable: /nix/store/p4fyy5y58d48fdp6z2wnnbvsrlc9mdwh-neovim-0.10.1/bin/nvim-python3
- Python version: 3.12.5
- pynvim version: 0.5.0
- OK Latest pynvim is installed.

Python virtualenv ~
- OK no $VIRTUAL_ENV

==============================================================================
provider.ruby: require("provider.ruby.health").check()

Ruby provider (optional) ~
- Disabled (loaded_ruby_provider=0).

==============================================================================
telescope: require("telescope.health").check()

Checking for required plugins ~
- OK plenary installed.
- OK nvim-treesitter installed.

Checking external dependencies ~
- OK rg: found ripgrep 14.1.0
- OK fd: found fd 10.2.0

===== Installed extensions ===== ~

Telescope Extension: `fzf` ~
- OK lib working as expected
- OK file_sorter correctly configured
- OK generic_sorter correctly configured

==============================================================================
vim.lsp: require("vim.lsp.health").check()

- LSP log level : WARN
- Log path: /home/symph/.local/state/nvim/lsp.log
- Log size: 0 KB

vim.lsp: Active Clients ~
- No active clients

vim.lsp: File Watcher ~
- file watching "(workspace/didChangeWatchedFiles)" disabled on all clients

vim.lsp: Position Encodings ~
- No active clients

==============================================================================
vim.treesitter: require("vim.treesitter.health").check()

- Nvim runtime ABI version: 14
- OK Parser: norg                 ABI: 14, path: /nix/store/58xx8vlzzs1w8nimkqx9ab61r2fwig4i-vim-pack-dir/pack/myNeovimPackages/start/vimplugin-treesitter-grammars/parser/norg.so
- OK Parser: norg_meta            ABI: 14, path: /nix/store/58xx8vlzzs1w8nimkqx9ab61r2fwig4i-vim-pack-dir/pack/myNeovimPackages/start/vimplugin-treesitter-grammars/parser/norg_meta.so
- OK Parser: c                    ABI: 14, path: /nix/store/gqszxhf1ccbivwmvdiqv5kkbiqagzrnb-neovim-unwrapped-0.10.1/lib/nvim/parser/c.so
- OK Parser: lua                  ABI: 14, path: /nix/store/gqszxhf1ccbivwmvdiqv5kkbiqagzrnb-neovim-unwrapped-0.10.1/lib/nvim/parser/lua.so
- OK Parser: markdown             ABI: 14, path: /nix/store/gqszxhf1ccbivwmvdiqv5kkbiqagzrnb-neovim-unwrapped-0.10.1/lib/nvim/parser/markdown.so
- OK Parser: markdown_inline      ABI: 14, path: /nix/store/gqszxhf1ccbivwmvdiqv5kkbiqagzrnb-neovim-unwrapped-0.10.1/lib/nvim/parser/markdown_inline.so
- OK Parser: query                ABI: 14, path: /nix/store/gqszxhf1ccbivwmvdiqv5kkbiqagzrnb-neovim-unwrapped-0.10.1/lib/nvim/parser/query.so
- OK Parser: vim                  ABI: 14, path: /nix/store/gqszxhf1ccbivwmvdiqv5kkbiqagzrnb-neovim-unwrapped-0.10.1/lib/nvim/parser/vim.so
- OK Parser: vimdoc               ABI: 14, path: /nix/store/gqszxhf1ccbivwmvdiqv5kkbiqagzrnb-neovim-unwrapped-0.10.1/lib/nvim/parser/vimdoc.so

[MattSturgeon]

You are setting treesitterPackage = null, which means we won't install a tree-sitter binary.

This package is how we install the grammar packages. OTTOMH, it's something like treesitterPackage.withGrammars cfg.grammarPackages.

We should probably have an assertion or a warning though, if the package is null and the grammar packages are configured.

[khaneliman]

Actually... we use the package, not the treesitterPackage. The treesitterPackage is if you don't want to use nixGrammars.

[MattSturgeon]

Ah, my mistake!

[khaneliman]

Unfortunately, I can recreate it locally. Gonna bisect.

[SymphonySimper]

I do not use rest plugin. But found the commit that caused this issue. After this point treesitter isn't installing any grammar.
So the current working flake for me is github:nix-community/nixvim/2a054b039e172d4f1cc5469dfbd5a02d21a4902f.

[SymphonySimper]

Created #2222 that fixes the issue I had that looked just like yours. If you had plugins.rest enabled, it somehow was breaking a couple plugins in our new location.

Thanks for the quick response, but I still have this issue.

[MattSturgeon]

I think we'll have to bisect using the linked flake and nix flake lock --override-input

[SymphonySimper]

I'm really sorry @khaneliman and @MattSturgeon. The issue happens only when I use Neorg's overlay (github:nvim-neorg/nixpkgs-neorg-overlay). I'm still working on finding the root cause. Thankyou for your time!