Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add External VectorDB Connections #872

Merged
merged 12 commits into from
Oct 23, 2024
Merged

Add External VectorDB Connections #872

merged 12 commits into from
Oct 23, 2024

Conversation

vkehfdl1
Copy link
Contributor

No description provided.

jeffrey and others added 3 commits October 19, 2024 23:14
…collection to Chroma vector store instance. (#871)

* add Chroma wrapper for vectorstore compatibility

* Make my own Chroma class

* refactor get_id_scores

* replace chroma to VectorStore instance with async

* use vector store embedding at vectordb module

* optimize imports

---------

Co-authored-by: jeffrey <vkefhdl1@gmail.com>
@vkehfdl1 vkehfdl1 linked an issue Oct 20, 2024 that may be closed by this pull request
vkehfdl1 and others added 9 commits October 21, 2024 17:24
…ordb module. (#874)

* make load_yaml_config for easier retrieve config yaml file

* load vectordb instance from config YAML file

* load vectordb from YAML in the vectordb module

* fixed wrong annotation

---------

Co-authored-by: jeffrey <vkefhdl1@gmail.com>
* add filter from corpus data and filter from retrieval_gt for optional ingest

* make Evaluator with external vectordb working.

---------

Co-authored-by: jeffrey <vkefhdl1@gmail.com>
Co-authored-by: jeffrey <vkefhdl1@gmail.com>
* extract vectordb and save it to extracted yaml as also

* add delete collection method for milvus

* edit hybrid testing for new vectordb

* optimize imports at test_hybrid_cc.py

---------

Co-authored-by: jeffrey <vkefhdl1@gmail.com>
* add vector db documentations (milvus and chroma)

* change documentation file for vectordb

* Fix all sample config YAML file to use vectordb

---------

Co-authored-by: jeffrey <vkefhdl1@gmail.com>
@vkehfdl1 vkehfdl1 marked this pull request as ready for review October 23, 2024 13:26
@vkehfdl1 vkehfdl1 requested a review from bwook00 October 23, 2024 13:26
@vkehfdl1 vkehfdl1 enabled auto-merge (squash) October 23, 2024 13:26
Copy link
Contributor

@bwook00 bwook00 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@vkehfdl1 vkehfdl1 merged commit 441df24 into main Oct 23, 2024
3 checks passed
@vkehfdl1 vkehfdl1 deleted the Feature/#830 branch October 23, 2024 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature Request] Connect different Vector Stores as vectordb.
2 participants