tokenizer.py ResourceWarning #1757
zhangyuezhong
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
lib\site-packages\whisper\tokenizer.py:327: ResourceWarning: unclosed file <_io.TextIOWrapper name='XXXXXXXX\openaiwhisper\venv\lib\site-packages\whisper\assets\multilingual.tiktoken' mode='r' encoding='cp1252'>
ranks = {
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Python 3.10.11
with open(vocab_path, 'r', encoding='utf-8') as file:
ranks = {
base64.b64decode(token): int(rank)
for token, rank in (line.split() for line in file if line)
}
Beta Was this translation helpful? Give feedback.
All reactions