Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How could I run this on windows 10? #10

Open
KevinRyu opened this issue Dec 12, 2023 · 5 comments
Open

How could I run this on windows 10? #10

KevinRyu opened this issue Dec 12, 2023 · 5 comments

Comments

@KevinRyu
Copy link

KevinRyu commented Dec 12, 2023

Hello,

When I tried to install packages with requirements.txt, I got the following error.

Error
ERROR: Could not find a version that satisfies the requirement triton (from mamba-ssm) (from versions: none)
ERROR: No matching distribution found for triton

As I know, triton package supports something like linux only.
What should I do?

@justusmattern27
Copy link
Member

Hey, it probably doesn't make sense to run this on Windows as you'll need a GPU (which I assume you don't have locally). It's probably best to use some cloud GPU service or just run on Google Colab. You can find a demo Mamba-Chat on Google Colab here

@SzaremehrjardiMT
Copy link

Hey, it probably doesn't make sense to run this on Windows as you'll need a GPU (which I assume you don't have locally). It's probably best to use some cloud GPU service or just run on Google Colab. You can find a demo Mamba-Chat on Google Colab here

Does Mamba Chat only run on a GPU?

@justusmattern27
Copy link
Member

@SzaremehrjardiMT Currently yes. There's an open issue in llama.cpp to support the mamba architecture, though, which would make it possible to run without a GPU: ggerganov/llama.cpp#4353

@KevinRyu
Copy link
Author

KevinRyu commented Dec 14, 2023

Hey, it probably doesn't make sense to run this on Windows as you'll need a GPU (which I assume you don't have locally). It's probably best to use some cloud GPU service or just run on Google Colab. You can find a demo Mamba-Chat on Google Colab here

  • Because of security or several reason, we are not allowed to use operating system except windows 10 in our company. And we are not allowed to use WSL2. I'm sorry to ask supporting windows OS. I have a company desktop with GPU. But I'm struggling with something like these troubles related to OS. I successfully run colab notebook in company outside. Thanks.

@richardburleigh
Copy link

@KevinRyu It won't be optimized, but you can try mamba-minimal

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants