v0.10.6 Better fp16 perf in python, fix memory issues in scalar indices
What's Changed
- feat: expose migration check by @wjones127 in #2074
- chore: loading HNSW levels in parallel by @BubbleCal in #2093
- chore: construct the dist table only once while searching by @BubbleCal in #2094
- feat: enable fp16kernels in Mac and x86 Linux Python wheels by @wjones127 in #2098
- feat: support IVF_HNSW index by @BubbleCal in #2080
- perf: create ood dataset in bigann benchmark by @eddyxu in #2084
- chore: fix the time unit in logs by @BubbleCal in #2101
- chore: dynamically detect the schema while shuffling data by @BubbleCal in #2105
- chore: expose find_partition method by @chebbyChefNEQ in #2106
- fix: very low recall on IVF_HNSW by @BubbleCal in #2104
- fix: load_partition return Error when partition_id out of bounds by @LeoReeYang in #2107
- chore: expose query residulization by @chebbyChefNEQ in #2108
- chore: move java core api to sub java module by @LuQQiu in #2115
- docs: update image_to_tensor to to_tensor by @vipul-maheshwari in #2116
- perf: independent parallel building for IVF_HNSW partitions by @BubbleCal in #2109
- chore: add example of IVF_HNSW by @BubbleCal in #2112
- perf: fully building HNSW partitions in parallel by @BubbleCal in #2117
- perf: load HNSW levels in parallel by @BubbleCal in #2111
- chore: drop data after copied to reduce memory footprint by @BubbleCal in #2120
- fix: populate index cache at the end of loading by @chebbyChefNEQ in #2123
- fix: use the fair spill pool instead of the greedy spill pool by @westonpace in #2126
- feat: support create IVF_HNSW_PQ index in Python by @BubbleCal in #2127
- feat: add scalar quantizer by @BubbleCal in #2134
- fix: the HNSW index doesn't respect to refine factor by @BubbleCal in #2122
- feat: add sq storage and transformer by @BubbleCal in #2135
New Contributors
- @LeoReeYang made their first contribution in #2107
- @vipul-maheshwari made their first contribution in #2116
Full Changelog: v0.10.5...v0.10.6