App Crashes When I Try To Load Orenguteng/Llama-3.1-8B

[NeonGalaxiie]

Bug Report

Unexpected Crash

Steps to Reproduce

I installed Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF to use, but the app crashes every time i try to load the model

Expected Behavior

Obviously, I expected the model to load and run, but the app crashes instead

Your Environment

• GPT4All version (if applicable): Latest Version (3.5?)
• Operating System: Kali Linux
• Chat model used (if applicable): Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

[manyoso]

Which backend are you using? Vulkan? CUDA? CPU? How much RAM do you have? How much VRAM?

[manyoso]

Works for me.

I've loaded it with CUDA, Vulkan, and CPU. Works fine on all three for me, but then I have a lot of RAM. I'm guessing you're hitting an OOM because you don't have enough RAM or VRAM.

[NeonGalaxiie]

Which backend are you using? Vulkan? CUDA? CPU? How much RAM do you have? How much VRAM?

I'm not very technical, so I don't know which backend I'm using (unless that's the "compute" device, which I've tried both my NVIDIA GPU and the CPU). My laptop has 16GB RAM. I don't think it has VRAM.