Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make issue on sbc odroid #482

Closed
UnknownEnergy opened this issue Mar 24, 2023 · 2 comments
Closed

make issue on sbc odroid #482

UnknownEnergy opened this issue Mar 24, 2023 · 2 comments
Labels
hardware Hardware related need more info The OP should provide more details about the issue

Comments

@UnknownEnergy
Copy link

I am trying to run "make" on an odroid sbc and get following error:

`I llama.cpp build info:
I UNAME_S: Linux
I UNAME_P: unknown
I UNAME_M: armv7l
I CFLAGS: -I. -O3 -DNDEBUG -std=c11 -fPIC -pthread -mfpu=neon-fp-armv8 -mfp16-format=ieee -mno-unaligned-access -funsafe-math-optimizations
I CXXFLAGS: -I. -I./examples -O3 -DNDEBUG -std=c++11 -fPIC -pthread
I LDFLAGS:
I CC: cc (Debian 10.2.1-6) 10.2.1 20210110
I CXX: g++ (Debian 10.2.1-6) 10.2.1 20210110

cc -I. -O3 -DNDEBUG -std=c11 -fPIC -pthread -mfpu=neon-fp-armv8 -mfp16-format=ieee -mno-unaligned-access -funsafe-math-optimizations -c ggml.c -o ggml.o
ggml.c: In function ‘ggml_vec_mad_q4_0’:
ggml.c:2049:35: warning: implicit declaration of function ‘vzip1_s8’; did you mean ‘vzipq_s8’? [-Wimplicit-function-declaration]
2049 | const int8x8_t vxlt = vzip1_s8(vxls, vxhs);
| ^~~~~~~~
| vzipq_s8
ggml.c:2049:35: error: incompatible types when initializing type ‘int8x8_t’ using type ‘int’
ggml.c:2050:35: warning: implicit declaration of function ‘vzip2_s8’; did you mean ‘vzipq_s8’? [-Wimplicit-function-declaration]
2050 | const int8x8_t vxht = vzip2_s8(vxls, vxhs);
| ^~~~~~~~
| vzipq_s8
ggml.c:2050:35: error: incompatible types when initializing type ‘int8x8_t’ using type ‘int’
make: *** [Makefile:222: ggml.o] Error 1
`

Also trying to run the docker image causes following:

Unable to find image 'ghcr.io/ggerganov/llama.cpp:light' locally
light: Pulling from ggerganov/llama.cpp
docker: no matching manifest for linux/arm/v7 in the manifest list entries.
See 'docker run --help'.

@SlyEcho
Copy link
Collaborator

SlyEcho commented Mar 25, 2023

These instructions are for Arm64 and won't be able to be used on a 32-bit build.

Maybe you can try without the Neon SIMD but it will be very slow.

@gjmulder gjmulder added need more info The OP should provide more details about the issue hardware Hardware related labels Mar 26, 2023
@sw
Copy link
Contributor

sw commented May 18, 2023

#1405 removed the vzips

@sw sw closed this as not planned Won't fix, can't repro, duplicate, stale May 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
hardware Hardware related need more info The OP should provide more details about the issue
Projects
None yet
Development

No branches or pull requests

4 participants