Code

add: use token_str from vocab#34

Code

Open

juvi21 wants to merge 2 commits intomistralai:mainmistralai/mistral-common:mainfrom juvi21:tokens_str-from-vocabjuvi21/mistral-common:tokens_str-from-vocabCopy head branch name to clipboard

+9-3

Commits

Commits on Aug 3, 2024

• add: use token_str from vocab

  juvi21

  authored
  9f4a6b9

• Update tekken.py

  Show description for 043712c
  juvi21

  authored
  043712c