Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question]: "Building wheel for flash_attn (setup.py) " for a long time without any notification #37

Closed
qiling1345 opened this issue Jul 15, 2024 · 1 comment
Assignees
Labels
question Further information is requested

Comments

@qiling1345
Copy link

Describe the issue

Requirement already satisfied: mpmath>=0.19 in ./python/3.10.12/lib/python3.10/site-packages (from sympy->torch->minference) (1.2.1)
Building wheels for collected packages: minference, flash_attn
Building wheel for minference (setup.py) ... done
Created wheel for minference: filename=minference-0.1.4.post2-cp310-cp310-linux_x86_64.whl size=3547476 sha256=93f5a7f879dafae55626633576005655e19b00c388a48ff8ad1bdf32993ed52f
Stored in directory: /root/.cache/pip/wheels/42/57/2b/cc98ec52e123b55cca8d6830dc696017d312a553c67bb49024
Building wheel for flash_attn (setup.py) ... \

@qiling1345 qiling1345 added the question Further information is requested label Jul 15, 2024
@qiling1345 qiling1345 changed the title [Question]: stick "Building wheel for flash_attn (setup.py) " for a long time without any notification [Question]: "Building wheel for flash_attn (setup.py) " for a long time without any notification Jul 15, 2024
@iofu728
Copy link
Contributor

iofu728 commented Jul 15, 2024

Please upgrade MInference to version 0.1.4.post3, which does not depend on flash_attn. You can do this by running the following command:

pip install minference==0.1.4.post3

@iofu728 iofu728 self-assigned this Jul 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants