Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Intel ARC GPU support #72

Open
ElliottDyson opened this issue Apr 16, 2024 · 1 comment
Open

Intel ARC GPU support #72

ElliottDyson opened this issue Apr 16, 2024 · 1 comment

Comments

@ElliottDyson
Copy link

Hello, probably a big ask, but would you consider adding intel arc GPU acceleration (it also invariantly speeds up Intel CPUs), however, there are plenty of examples over in the IPEX-LLM repo for implementations. It's a long shot, but it would truly be great if possible.

All that would be required for the user would be a warning to visit the IPEX-LLM docs to install the necessary library.

The examples include loading to and from the GPU, etc., and includes a pytorch version specific for the GPUs.

Hopefully this is possible, as without GPU acceleration the program can be really rather slow.

Thank you.

@ElliottDyson
Copy link
Author

I would be more than happy to help, I'd just need a pointer to the areas where things are currently being loaded to Nvidia GPUs so it can be rewritten for Ipex as the file structure you have here is rather dense (there would probably have to be a separate download for Ipex tbh).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant