New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

scaled_dot_product_attention() got an unexpected keyword argument 'scale' Error #763

Closed

ChangeNext opened this issue Nov 22, 2023 · 1 comment

ChangeNext commented Nov 22, 2023

python generate/base.py --prompt "Hello, my name is" --checkpoint_dir checkpoints/stabilityai/stablelm-base-alpha-3b

occur error this

TypeError :scaled_dot_product_attention() got an unexpected keyword argument 'scale' Error

my torch version = 2.0.1+cu117

Collaborator

Andrei-Aksionov commented Nov 22, 2023

Hello @ChangeNext
The current codebase relies on PyTorch >= 2.1:
https://github.com/Lightning-AI/lit-gpt/blob/21c1c5941fd56216875a250fb2c03053ba649793/requirements.txt#L1

Could you upgrade it?
Ideally upgrade all the packages in a freshly created virtual environment.

carmocca closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment