Skip to content

Commit

Permalink
Add create_or_replace_document_objects method to weaviate provider (#…
Browse files Browse the repository at this point in the history
…36177)

* Add CRUD operations arounf schema and class objects

* Handle casees when the properties are not in same order

* Change the methods name and docstring

* Resolve conflicts

* Make sure the retrying is working as expected

* Address PR comments

* Remove retry logic from

* Remove vector_col params and dataframe support

* Remove unwanted retry logic

* Address PR comments

* Resolve ruff-lint issues

* Remove unwanted changes

* Remove unwanted changes

* Change the exception to rety on

* [WIP] Add ingest methods

* Fix static checks

* Optimize for error case

* Fix test docstring and handle missing case

* Remove duplicate rows from dataframe

* Updated the logic for object creation based on documents

* Update docstring for 'create_or_replace_document_objects' method

* refactored code

* Update airflow/providers/weaviate/hooks/weaviate.py

Co-authored-by: Josh Fell <48934154+josh-fell@users.noreply.github.com>

* Update airflow/providers/weaviate/hooks/weaviate.py

Co-authored-by: Josh Fell <48934154+josh-fell@users.noreply.github.com>

* Remove typo

* Add better names

* Add testcases

* Addressed PR comments

* Fix testcases

* Fix docstring

* Fix docstring

* Address static code issue

* Fix typing issue

* Fix typing issue

---------

Co-authored-by: Josh Fell <48934154+josh-fell@users.noreply.github.com>
  • Loading branch information
utkarsharma2 and josh-fell authored Dec 23, 2023
1 parent 77b563b commit 75d74b1
Show file tree
Hide file tree
Showing 2 changed files with 699 additions and 11 deletions.
Loading

0 comments on commit 75d74b1

Please sign in to comment.