We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
内存吃满，运行其慢，比使用cpu(float)还慢，求教如何调整
No response
tokenizer = AutoTokenizer.from_pretrained("/Users/XX/Projects/6b/chatglm-6b", trust_remote_code=True) model = AutoModel.from_pretrained("/Users/XX/Projects/6b/chatglm-6b", trust_remote_code=True).half().to("mps")
m1 13.3.1 (22E261) pytorch 2.1.0.dev20230425
The text was updated successfully, but these errors were encountered:
#462
Sorry, something went wrong.
No branches or pull requests
Is there an existing issue for this?
Current Behavior
内存吃满，运行其慢，比使用cpu(float)还慢，求教如何调整
Expected Behavior
No response
Steps To Reproduce
tokenizer = AutoTokenizer.from_pretrained("/Users/XX/Projects/6b/chatglm-6b", trust_remote_code=True) model = AutoModel.from_pretrained("/Users/XX/Projects/6b/chatglm-6b", trust_remote_code=True).half().to("mps")Environment
Anything else?
No response
The text was updated successfully, but these errors were encountered: