fix(semantic/jsdoc): Support multibyte chars

[leaysgur]

Fix for #2642 (comment)

Any advice would be appreciated as I'm not too sure about this area. 🥹

[codspeed-hq]

CodSpeed Performance Report

Merging #2694 will not alter performance

_{Comparing fix-multibyte-jsdoc (df72c9d) with main (0f86333)}

Summary

✅ 29 untouched benchmarks

[Boshen]

You can improve the whole lexer by using Chars and Peekable:

#[derive(Debug)]
pub struct JSDocParser<'a> {
    chars: Peekable<Chars<'a>>,
}

impl<'a> JSDocParser<'a> {
    pub fn new(source_text: &'a str) -> Self {
        let chars = source_text.trim().chars().peekable();
        Self { chars }
    }

Or maybe just Chars + an offset

#[derive(Debug)]
pub struct JSDocParser<'a> {
    chars: Chars<'a>,
    current: usize,
}

[leaysgur]

Thank you for your time + support @Boshen !!

by using Chars and Peekable:

I will try it again one day.