Begin to add CTC HLG decoding

[csukuangfj]

No description provided.

[csukuangfj]

Usage of this PR

Download pre-trained zipformer CTC model

git lfs install
git clone https://huggingface.co/csukuangfj/sherpa-onnx-zipformer-ctc-en-2023-10-02

ls -lh sherpa-onnx-zipformer-ctc-en-2023-10-02/

-rw-r--r--@ 1 fangjun  staff   3.8M Oct  7 02:45 H.fst
-rw-r--r--@ 1 fangjun  staff    27M Oct  7 02:45 HL.fst
-rw-r--r--@ 1 fangjun  staff   334M Oct  7 02:45 HLG.fst
-rw-r--r--@ 1 fangjun  staff   309B Oct  7 02:45 README.md
-rw-r--r--@ 1 fangjun  staff    67M Oct  7 02:45 model.int8.onnx
-rw-r--r--@ 1 fangjun  staff   249M Oct  7 02:45 model.onnx
drwxr-xr-x@ 5 fangjun  staff   160B Oct  7 02:45 test_wavs
-rw-r--r--@ 1 fangjun  staff   4.9K Oct  7 02:45 tokens.txt
-rw-r--r--@ 1 fangjun  staff   2.9M Oct  7 02:45 words.txt

Decoding with H

./build/bin/sherpa-onnx-offline \
  --model-type=zipformer2_ctc \
  --ctc.graph=./sherpa-onnx-zipformer-ctc-en-2023-10-02/H.fst \
  --zipformer-ctc-model=./sherpa-onnx-zipformer-ctc-en-2023-10-02/model.onnx \
  --tokens=./sherpa-onnx-zipformer-ctc-en-2023-10-02/tokens.txt \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/0.wav  \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/1.wav \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/2.wav

Decoding with HL

./build/bin/sherpa-onnx-offline \
  --model-type=zipformer2_ctc \
  --ctc.graph=./sherpa-onnx-zipformer-ctc-en-2023-10-02/HL.fst \
  --zipformer-ctc-model=./sherpa-onnx-zipformer-ctc-en-2023-10-02/model.onnx \
  --tokens=./sherpa-onnx-zipformer-ctc-en-2023-10-02/tokens.txt \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/0.wav  \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/1.wav \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/2.wav

Decoding with HLG

./build/bin/sherpa-onnx-offline \
  --model-type=zipformer2_ctc \
  --ctc.graph=./sherpa-onnx-zipformer-ctc-en-2023-10-02/HLG.fst \
  --zipformer-ctc-model=./sherpa-onnx-zipformer-ctc-en-2023-10-02/model.onnx \
  --tokens=./sherpa-onnx-zipformer-ctc-en-2023-10-02/tokens.txt \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/0.wav  \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/1.wav \
  ./sherpa-onnx-zipformer-ctc-en-2023-10-02/test_wavs/2.wav