Skip to content

Commit

Permalink
The LLaMA PR has been merged into transformers
Browse files Browse the repository at this point in the history
huggingface/transformers#21955

The tokenizer class has been changed from

"LLaMATokenizer"

to

"LlamaTokenizer"

It is necessary to edit this change in every tokenizer_config.json
that you had for LLaMA so far.
  • Loading branch information
oobabooga committed Mar 16, 2023
1 parent d54f3f4 commit 23a5e88
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,4 @@ rwkv==0.4.2
safetensors==0.3.0
sentencepiece
tqdm
git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
git+https://github.com/huggingface/transformers

0 comments on commit 23a5e88

Please sign in to comment.