Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

should we just convert FP32 to fp16 automatically? #37448

Closed
liliu-z opened this issue Nov 5, 2024 · 3 comments
Closed

should we just convert FP32 to fp16 automatically? #37448

liliu-z opened this issue Nov 5, 2024 · 3 comments
Assignees
@cqy123456
Labels
stale indicates no udpates for 30 days

Comments

@liliu-z
Copy link
Member

liliu-z commented Nov 5, 2024

should we just convert FP32 to fp16 automatically?
@smellthemoon @liliu-z @tedxu any thoughts on this?

This is worth debating: If yes, means we modify the data from users' side and store it. Some operations like GetVector's meaning will get hurt. If no, SDK user experience, especially RESTFUL API will suffer

They define their vector as BF16/FP16 already. and there is no easy way to represent BF16/FP16 on most the languages. If data lose accuracy it's user's choice.

If they want to keep original data they should use Fp32 float + Floa16/BF16 quantazition or int8 quantazation in the future

Originally posted by @xiaofan-luan in #37123 (reply in thread)
@liliu-z
Copy link
Member Author

liliu-z commented Nov 5, 2024

/assign @cqy123456

@xiaofan-luan
Copy link
Collaborator

I think this definitely makes user's understanding easier

jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 8, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
033d02f 
issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
@jiangyinzuo jiangyinzuo mentioned this issue Nov 8, 2024
Merged
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 8, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
b990bae 
issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 9, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
13cec0b 
RESTful API has 3 handlers. The API changed are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 9, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
41dc76b 
RESTful API has 3 handlers. The API changed are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 9, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
43c1181 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 9, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
fbffef4 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 10, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
69831ba 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 10, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
a900400 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 11, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
bd88e93 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 11, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
8b004b8 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 11, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
3b0152c 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 11, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
e8c2f3c 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 11, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API
53b5480 
RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 15, 2024
@jiangyinzuo
feat: fp32 vector to fp16/bf16 vector conversion for RESTful API and …
dd52dd8 
…Go SDK

RESTful API has 3 handlers. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 15, 2024
@jiangyinzuo
feat: [GoSDK] fp32 to fp16/bf16 vector conversion for RESTful API and…
297f8ff 
… Go SDK

RESTful API

The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

Go SDK

- Add new API for fp vector conversions

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 16, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
8665b16 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 17, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
0fbeadc 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 17, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
514ab06 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 18, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
e0e0d75 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

Module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 18, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
c96ad73 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

Module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 18, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
a7a5070 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

Module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 18, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
731c747 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

Module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 18, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
871da44 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

Module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 19, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
3ff7f84 
RESTful API. The influenced API are as follows:

- Handler. insert
- HandlerV1. insert/upsert
- HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

Module github.com/milvus-io/milvus/pkg:

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 21, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
b6ae5e9 
Make the Milvus server support the conversion from fp32 to fp16/bf16,
so as to facilitate the client users who have difficulties in handling
fp16/bf16 conversions.

1. The influenced RESTful API are as follows:
    - Handler. insert
    - HandlerV1. insert/upsert
    - HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

2. Add micro-benchmarks for various vector serialization methods.
3. Module github.com/milvus-io/milvus/pkg.

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus that referenced this issue Nov 21, 2024
@jiangyinzuo
feat: fp32 to fp16/bf16 vector conversion for RESTful API
a48b5a7 
Make the Milvus server support the conversion from fp32 to fp16/bf16,
so as to facilitate the client users who have difficulties in handling
fp16/bf16 conversions.

1. The influenced RESTful API are as follows:
    - Handler. insert
    - HandlerV1. insert/upsert
    - HandlerV2. insert/upsert/search

We do not modify search API in Handler/HandlerV1 because they do not
support fp16/bf16 vectors.

2. Add micro-benchmarks for various vector serialization methods.
3. Module github.com/milvus-io/milvus/pkg.

Add `Float32ArrayToBFloat16Bytes()`, `Float32ArrayToFloat16Bytes()` and
`Float32ArrayToBytes()`. These method will be used in GoSDK in the
future.

issue: milvus-io#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-java that referenced this issue Nov 29, 2024
@jiangyinzuo
Update Float16VectorExample.java (milvus-io#1203)
4420b57 
milvus-sdk-java has already implemented fp32 <-> fp16/bf16
conversion methods, this PR just updates the related example.

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-java that referenced this issue Nov 29, 2024
@jiangyinzuo
Update Float16VectorExample.java (milvus-io#1203)
3d1c9a8 
milvus-sdk-java has already implemented fp32 <-> fp16/bf16
conversion methods, this PR just updates the related example.

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
This was referenced Nov 29, 2024
Merged
Merged
sre-ci-robot pushed a commit to milvus-io/pymilvus that referenced this issue Dec 2, 2024
@jiangyinzuo
enhance: update float16/bfloat16 examples (#2388)
9ebd67d 
In the Python ecosystem, users may use basic libraries such as numpy,
Pandas, TensorFlow, PyTorch... to process float16/bfloat16 vectors.
However, users may have float32 vectors and are not clear about
how to handle float16/bfloat16 vectors in pymilvus.

Currently, pymilvus supports numpy array as embedding vector inputs.
However, numpy itself does not support bfloat16 type.

This PR demonstrates the way of converting float arrays in insert/search
API.

**insert (accept numpy array as input)**:

- float32 vector (owned by users) -> float16 vector (input param of
insert API). numpy is enough, no more dependency.
- float32 vector (owned by users) -> bfloat16 vector (input param of
insert API). Depends on `tf.bfloat16`. Pytorch can not convert
`torch.bfloat16` to numpy array.

**search (the API returns bytes as float16/bfloat16 vector)**:

- float16 vector (bytes). User can convert it into numpy array, PyTorch
Tensor or TensorFlow Tensor.
- bfloat16 vector (bytes). User can convert it into PyTorch Tensor or
TensorFlow Tensor.

There are many deep learning platforms available in Python, and
we can't determine which ecosystem users want. Therefore, this PR
doesn't add the method for float vector conversion in pymilvus.

References:

- numpy/numpy#19808
- pytorch/pytorch#90574

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
sre-ci-robot pushed a commit to milvus-io/milvus-sdk-java that referenced this issue Dec 2, 2024
@jiangyinzuo
Update Float16VectorExample.java (#1203) (#1204)
355af1b 
milvus-sdk-java has already implemented fp32 <-> fp16/bf16
conversion methods, this PR just updates the related example.

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
sre-ci-robot pushed a commit to milvus-io/milvus-sdk-java that referenced this issue Dec 2, 2024
@jiangyinzuo
Update Float16VectorExample.java (#1203) (#1205)
aeb4409 
milvus-sdk-java has already implemented fp32 <-> fp16/bf16
conversion methods, this PR just updates the related example.

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 4, 2024
@jiangyinzuo
feat: support fp16/bf16 vector
c06e362 
issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
@jiangyinzuo jiangyinzuo mentioned this issue Dec 4, 2024
Open
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 4, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
0638758 
BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 5, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
b9f4f8c 
BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 5, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
8611da7 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 5, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
7ff5957 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
@stale Stale
Copy link

stale bot commented Dec 8, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

@stale stale bot added the stale indicates no udpates for 30 days label Dec 8, 2024
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 13, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
485f0aa 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 13, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
c6f15b4 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 13, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
1ed242c 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 13, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
2874e3b 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 13, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
147b88f 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 13, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
37b6a71 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 13, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
d6ec082 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 15, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
6cb61ae 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 15, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
94b52a3 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 15, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
17059e2 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 16, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
dc18974 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-cpp that referenced this issue Dec 20, 2024
@jiangyinzuo
feat!: fp16/bf16 vector support
44c65be 
issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-rust that referenced this issue Dec 20, 2024
@jiangyinzuo
feat!: support fp16/bf16 vector
dc4f991 
Depends on [half](https://crates.io/crates/half/) crate.

Add fp32/fp64/fp16/bf16 Vec conversion.

BREAKING CHANGES:

- `FieldColumn::new() -> FieldColumn` -> `FieldColumn::new() -> Result<FieldColumn>`
    - add type checking so it may return Error

issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
@stale stale bot closed this as completed Dec 21, 2024
jiangyinzuo added a commit to jiangyinzuo/milvus-sdk-cpp that referenced this issue Dec 22, 2024
@jiangyinzuo
feat!: fp16/bf16 vector support
e1e863b 
issue: milvus-io/milvus#37448

Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@cqy123456 cqy123456

Labels
stale indicates no udpates for 30 days
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@cqy123456 @xiaofan-luan @liliu-z