feat: migrate to Shikiji

[atomiks]

Closes #107

[netlify]

✅ Deploy Preview for rehype-pretty-code ready!

Name	Link
🔨 Latest commit	e4a4f73
🔍 Latest deploy log	https://app.netlify.com/sites/rehype-pretty-code/deploys/656c2ab6582ca2000824f45d
😎 Deploy Preview	https://deploy-preview-109--rehype-pretty-code.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[dimaMachina]

I’ll try to take a look this week if I can help

[ovflowd]

Would love if this gets merged. Right now Shiki is not compatible with Next.js 14 or Turbopack or SWC... And using Shikiji would def solve many problems 🙇

[atomiks]

Think I managed to get this working. There are some API changes so it's partially breaking but most things are the same still

[atomiks]

I found a really weird bug with the md markdown language testing the beta on the website. It seems to be a Shikiji issue.

If the md language is registered before others, it ends up glitching them out:

```md
This is markdown block
```

```js
console.log('will not be highlighted');
```

`console.log('this even throws an error'){:js}`

Ensuring md is always registered last seems to fix the issues.

if (langsToLoad.has('md')) {
  langsToLoad.delete('md');
  langsToLoad.add('md');
}

I need to see how this also works on the client.

[atomiks]

• shikiji@0.7.6 fixes that issue above
• I added a transformers option (top-level), which works with the shikiji-transformers package; I've added test for it. So I think this PR: Adds Diff Highlighting #124 is no longer necessary @IanMitchell

[IanMitchell]

Perfect! Closed my PR, thank you!

[atomiks]

Thanks!

I'm going to keep the onVisit* hooks since transformers don't deal with some custom nodes this package adds.

I think this is mostly ready, but I've published 0.12.0-beta.1 to test out

[dimaMachina]

Just curious, why do you manually declare types? And don’t generate them based on src/index.ts file?

[atomiks]

It should be generated yeah :) Originally, the source was in plain JavaScript but I didn't update the way types were generated when I converted the codebase to TypeScript.

[dimaMachina]

This try catch block can be completely removed (with keeping code from try block) since you just re throw error in catch block?

[atomiks]

It's needed because if one of the languages throws then it should still continue with the rest

[dimaMachina]

Should be in dev dependencies?

[atomiks]

I'm not really sure if Shikiji itself should be a peer (locked to minor version though) - but this was just for testing purposes. The user would need to install it themselves (but again, might be a problem with versions)