Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Coredump in IndexHNSW #1662

Closed
zhangqiang4002 opened this issue Feb 2, 2021 · 2 comments
Closed

Coredump in IndexHNSW #1662

zhangqiang4002 opened this issue Feb 2, 2021 · 2 comments

Comments

@zhangqiang4002
Copy link

zhangqiang4002 commented Feb 2, 2021

Summary

Index Type: IVF4096,HNSW32, coredump when search
D = 100

Platform

OS: Linux 3.10.107

Faiss version: v1.7.0 7c2d238

Installed from: compiled by myself

Faiss compilation options:
-DFAISS_ENABLE_GPU=OFF -DBLA_VENDOR=Intel10_64_dyn -DMKL_LIBRARIES=${MKL_PATH}/libmkl_core.a -DFAISS_OPT_LEVEL=avx2 -DCMAKE_BUILD_TYPE=Release -DFAISS_ENABLE_PYTHON=OFF -DBUILD_TESTING=OFF

Running on:

  • [ x] CPU

Interface:

  • [ x] C++

Reproduction instructions

#0 0x0000000006534fcd in faiss::fvec_L2sqr(float const*, float const*, unsigned long) () #1 0x00000000065a0123 in faiss::HNSW::search(faiss::DistanceComputer&, int, long*, float*, faiss::VisitedTable&) const () #2 0x0000000006560698 in faiss::IndexHNSW::search(long, float const*, long, float*, long*) const [clone ._omp_fn.0] () #3 0x00007f92ea1d9d5f in GOMP_parallel () from /lib64/libgomp.so.1 #4 0x000000000655b7c3 in faiss::IndexHNSW::search(long, float const*, long, float*, long*) const () #5 0x000000000082cc60 in elasticfaiss::FaissIndex::search(long, std::vector<float, std::allocator<float> > const&, long, std::vector<float, std::allocator<float> >&, std::vector<long, std::allocator<long> >&) () #6 0x0000000000810090 in elasticfaiss::ShardNode::search(elasticfaiss::ShardSearchRequest const*, elasticfaiss::ShardSearchResponse*) () #7 0x0000000000800a9f in elasticfaiss::WorkNodeServiceImpl::search(google::protobuf::RpcController*, elasticfaiss::ShardSearchRequest const*, elasticfaiss::ShardSearchResponse*, google::protobuf::Closure*) () #8 0x000000000660e4f7 in elasticfaiss::WorkNodeService::CallMethod(google::protobuf::MethodDescriptor const*, google::protobuf::RpcController*, google::protobuf::Message const*, google::protobuf::Message*, google::protobuf::Closure*) () #9 0x00000000063982c8 in brpc::policy::ProcessRpcRequest(brpc::InputMessageBase*) () #10 0x000000000639cafe in brpc::InputMessenger::OnNewMessages(brpc::Socket*) () #11 0x00000000062ec01d in brpc::Socket::ProcessEvent(void*) () #12 0x00000000063f4cf7 in bthread::TaskGroup::task_runner(long) () #13 0x0000000006409331 in bthread_make_fcontext () #14 0x00010102464c457f in ?? () #15 0x0000000000000000 in ?? ()

@mdouze
Copy link
Contributor

mdouze commented Feb 2, 2021

Please narrow down how the core dump happens.
https://github.com/facebookresearch/faiss/wiki/Troubleshooting#things-to-report

@zhangqiang4002
Copy link
Author

zhangqiang4002 commented Feb 2, 2021

IndexHNSW do not support add_with_ids, I use add_with_ids to load vectors but actually the index is empty. When search in the empty index, coredump happened.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants