Fetched grammar queries not discovered

[heaths]

I'm trying to add grammar / LSP support for TypeSpec and its mostly working, but hx --health typespec shows:

Configured language servers:
  ✓ tsp-server: /usr/bin/tsp-server
Configured debug adapter: None
Configured formatter: None
Highlight queries: ✘
Textobject queries: ✘
Indent queries: ✘

I successfully ran hx -g fetch and hx -g build (with only the warning cargo:warning=Compiler version doesn't include clang or GCC: "c++" "--version") and ~/.config/helix/runtime/grammars does include both a typespec.so and sources/typespec, where the latter contains a queries subfolder:

grammars/sources/typespec/queries
  grammars/sources/typespec/queries/highlights.scm
  grammars/sources/typespec/queries/indents.scm
  grammars/sources/typespec/queries/injections.scm
grammars/typespec.so

Should the queries subfolder be copied up under the runtime directly directly, or what else is expected here?

The additions I made to languages.toml are:

use-grammars = { only = ["typespec"] }

[[grammar]]
name = "typespec"
source = { git = "https://github.com/happenslol/tree-sitter-typespec", rev = "28821d0d6da5f0a6b5eb02b9bad953fecafd7248" }

[[language]]
name = "typespec"
scope = "source.tsp"
injection-regex = "(tsp|typespec)"
file-types = ["tsp"]
roots = ["tspconfig.yaml"]
auto-format = true
comment-token = "//"
block-comment-tokens = { start = "/*", end = "*/" }
indent = { tab-width = 2, unit = "  " }
language-servers = ["typespec"]

[language-server.typespec]
command = "tsp-server"
args = ["--stdio"]

The scope matches our TextMate grammar, but I've also tried source.typespec here as well, which matches the tree-sitter grammar @happenslol created that I'm using above.

[kirawi]

Yes, you have to copy over the queries over to ~/.config/helix/runtime/queries/<lang> and likely do some tinkering. Queries are supposed to be tailored to each editor so it's not desirable in most cases to use the queries in the grammar source folder. Our highlighting scopes are documented at https://docs.helix-editor.com/themes.html#syntax-highlighting

[pascalkuthe]

a tree sitter grammr is a paser. Ther parser is a fully compiled C program (<grammar.so>) and essentially a full parser for that specific language. This parser is run by the editor and produces a syntax tree. Tree sitter has a query language that allows extracting information from these syntax trees which gets run when rendering and yields these scopes.

The parsers/syntax trees are identical across editors but which information you get out of them with queries is editor specific.

[heaths]

The scheme files are being compiled (or transpiled into C?) to the library? For the purpose of acquiring the grammar I'm working on (a git repo), is there any point in even fetching source and building the typespec.so file if I have to have the highlights.scm files and friends anyway?

[pascalkuthe]

As I explained in my last comment the queries and parser are entirely orthogonal. The parser is compiled from C sourcecoed into an so that is always needed.

The queries are loaded by helix at runtime and have nothing to do with the parser (except that they need to be compitle with the AST produced by the parser)

[kirawi]

To add, the grammar is generated from https://github.com/happenslol/tree-sitter-typespec/blob/main/src/parser.c which itself is generated from https://github.com/happenslol/tree-sitter-typespec/blob/main/grammar.js

[heaths]

@kirawi thank you for highlighting the relationship there. I understand now.