Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release 0.1.0-20240906 #203

Merged
merged 28 commits into from
Sep 6, 2024
Merged

Release 0.1.0-20240906 #203

merged 28 commits into from
Sep 6, 2024

Conversation

moria97
Copy link
Collaborator

@moria97 moria97 commented Sep 6, 2024

No description provided.

wwxxzz and others added 28 commits August 6, 2024 19:35
@wwxxzz
Replace PaiEas LLM with LLI-integration and upgrade python to 3.11 (#148
abcf17b 
)

* Replace PaiEas LLM with LLI-integration and upgrade python version to 3.11

* Replace MyFCDashScope with OpenAILike class

* Fix pyproject dependency
@aero-xi
bug fix (#149)
f15385e
@zt2645802240
Support postgresql load user dict (#150)
fe4d752 
* make format

* Allow not install extension pg_jieba

* table name data_default
@aero-xi @moria97
Convert raptor processor to TransformComponent (#151)
7df7f4b 
* udpate raptor using transform

* modify raptor with transform

* modify raptor and dataloader

---------

Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>
@moria97 @Ceceliachenen
Add clip model (#130)
4f58f66 
* Update

* Add clip model

* Fix oss cache

* Fix cache

* Pdf reader upload image

* Add multimodal

* Update config

* Use two embedding

* Add text_image node

* Add tests

* Fix tests

* fix multi_modal_vector

---------

Co-authored-by: 燃夏 <chenanyu.cay@alibaba-inc.com>
@moria97
Fix docker base image (#152)
6a6a2e7
@aero-xi
change insert to be sync (#153)
b93d7ee
@Ceceliachenen
Personal/ranxia/fix image readme (#155)
684b896 
* fix multi_modal and readme

* fix multi_modal and readme

* fix multi_modal and readme
@Ceceliachenen
fix multi_modal image (#156)
24fff62
@wwxxzz
Support Agentic RAG with intent and functioncalling (#154)
95e4bf3 
* Add intent detection module

* Remove LlmQuery class

* Support API

* Refactor agent module and format toml

* Refactor module tool

* Refactor query api

* Add demo and UI

* remove

* Fix reviews

* Add test for intent and api
@moria97
Add web search (#161)
49961e4 
* Add web search

* Fix lint

* Fix bug

* Update timeout

* Fix bug
@moria97
Fix jieba bug (#163)
312bac4
@moria97
Support PAI-EAS MultiModal LLM (#168)
f79d0c0 
* Support minicpm

* Fix issue
@wwxxzz
Bugfix: PaiEas LLM endpoint & max_tokens (#171)
d1a41d6
@moria97
Fix dashscope interface (#172)
e2e11b2 
* Fix dashscope llm

* Fix bug
@moria97
Fix test bug (#174)
2289b9f
@Ceceliachenen @wwxxzz @moria97
add minerU (#160)
4ef5451 
* add minerU

* add minerU

* add minerU

* Fix nodes id and simi_topK

* remove image url from text

* remove image url from text

* remove image url from text

* Support FAQ query w/o image (#162)

* Support FAQ query w/o image

* Using LLM when query w/o images

* Personal/ranxia/mineru enhancement (#164)

* remove repeat nodes

* show multiple pictures in media

* show multiple pictures in media

* Install miner with poetry (#165)

* fix retriever

* Support OSS Data Loader (#166)

* Support oss data loader

* Skip file which has been uploaded

* Support oss prefix via api

* 1. change image size (#167)

2. limit image number
3. fix retriever answer ui format

* adjust image score (#169)

* merge feature

* merge feature

* merge feature

* merge feature

* Fix bug (#173)

* Support chunk text-overflow display (#170)

* Fix bugs

* Support text-overflow

* Support text-overflow

* Support load MinerU config file automatically (#175)

* Support load MinerU config file automatically

* Modify

* Direct writing the config rather than copying

* Fix multi_modal build docker (#176)

* fix load_config (#177)

* change  multimodal prompt (#178)

* Test Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix test bug (#174) (#179)

Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>

* Fix Dockerfile (#180)

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix Dockerfile

* Fix docker env (#181)

* Fix Dockerfile

* Fix bugs

* Fix docker env

* Fix docker env

* Fix docker env (#183)

* Fix Dockerfile

* Fix bugs

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Bugfix

* Bugfix for EAS (#184)

* Fix Dockerfile

* Fix bugs

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Fix docker env

* Bugfix

* Bugfix

* Fix detectron link (#182)

* Update detectron dependency (#185)

* Update dependency

* udpate poetry lock

* fix multimodal_config and prompt (#186)

* fix MinerU readme (#189)

* Add timeout and more logs (#188)

* Personal/ranxia/fix miner u readme (#190)

* fix MinerU readme

* fix MinerU readme

* Personal/ranxia/fix miner u readme (#191)

* fix MinerU readme

* fix MinerU readme

* fix MinerU config

* fix MinerU bug (#192)

* Personal/ranxia/fix test and review bug (#193)

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

* fix MinerU bug

---------

Co-authored-by: 筱文 <zxw320697@alibaba-inc.com>
Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>
@Ceceliachenen
fix multimodal readme and config (#195)
08c15e0
@aero-xi @moria97
nl2sql refactoring (#194)
90c4301 
* change insert to be sync

* add nl2sql

* nl2sql setting

* nl2sql setting

* fix test bug

* fix bugs

* data analysis retriever and synthesizer

* fix tests bugs

* add data_analysis ui

* update poetry.lock

* remove unnecessary comment

* add fault tolerance if no file provided

* add minor fault tolerance

* add upload_datasheet

* nl2sql refactor and add db ui

* restore retriever & synthesizer

* update poetry.lock

* Fix list merge

* bug fix

* add default display

---------

Co-authored-by: 陆逊 <luxun.fy@alibaba-inc.com>
@aero-xi @moria97
Personal/xi/nl2sql UI (#196)
6c399b2 
* change insert to be sync

* add nl2sql

* nl2sql setting

* nl2sql setting

* fix test bug

* fix bugs

* data analysis retriever and synthesizer

* fix tests bugs

* add data_analysis ui

* update poetry.lock

* remove unnecessary comment

* add fault tolerance if no file provided

* add minor fault tolerance

* add upload_datasheet

* nl2sql refactor and add db ui

* restore retriever & synthesizer

* update poetry.lock

* Fix list merge

* bug fix

* add default display

* data_analysis ui update

---------

Co-authored-by: 陆逊 <luxun.fy@alibaba-inc.com>
@Ceceliachenen
Personal/ranxia/change max new tokens (#199)
0a90ee6 
* set multimodal llm max_new_tokens

* set multimodal llm max_new_tokens
@moria97
Add trace (#197)
b81cd6c 
* Add trace

* Fix bug

* Push to hangzhou region by default
@aero-xi @moria97
修复tables和descriptions默认配置bug (#198)
5f5453d 
* change insert to be sync

* add nl2sql

* nl2sql setting

* nl2sql setting

* fix test bug

* fix bugs

* data analysis retriever and synthesizer

* fix tests bugs

* add data_analysis ui

* update poetry.lock

* remove unnecessary comment

* add fault tolerance if no file provided

* add minor fault tolerance

* add upload_datasheet

* nl2sql refactor and add db ui

* restore retriever & synthesizer

* update poetry.lock

* Fix list merge

* bug fix

* add default display

* data_analysis ui update

* fix table & description & query_output bugs

* fix inconsistency between frontend and backend data structures

---------

Co-authored-by: 陆逊 <luxun.fy@alibaba-inc.com>
@moria97
Fix nginx routing (#200)
17ab2ea
@moria97
Fix nginx routing (#202)
35d8d06 
* Fix nginx routing

* Fix nginx config
@aero-xi @moria97
add data_analysis doc (#201)
ac45d52 
Co-authored-by: Yue Fei <luxun.fy@alibaba-inc.com>
@moria97
Merge remote-tracking branch 'origin/main' into feature
d7b22ff
@moria97
Resolve conflict
dda3ed6
@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 6, 2024

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines Covered Coverage Threshold Status
8002 3881 49% 40% 🟢

New Files

File Coverage Status
src/pai_rag/data/rag_oss_dataloader.py 13% 🟢
src/pai_rag/integrations/data_analysis/data_analysis_synthesizer.py 56% 🟢
src/pai_rag/integrations/data_analysis/data_analysis_tool.py 59% 🟢
src/pai_rag/integrations/data_analysis/nl2pandas_retriever.py 67% 🟢
src/pai_rag/integrations/data_analysis/nl2sql_retriever.py 58% 🟢
src/pai_rag/integrations/embeddings/clip/cnclip_embedding.py 43% 🟢
src/pai_rag/integrations/index/multi_modal_index.py 23% 🟢
src/pai_rag/integrations/llms/multimodal/open_ai_alike_multi_modal.py 50% 🟢
src/pai_rag/integrations/query_engine/multi_modal_query_engine.py 20% 🟢
src/pai_rag/integrations/retrievers/multi_modal_retriever.py 26% 🟢
src/pai_rag/integrations/search/bing_search.py 22% 🟢
src/pai_rag/integrations/search/bs4_reader.py 18% 🟢
src/pai_rag/modules/customconfig/custom_config.py 80% 🟢
src/pai_rag/modules/dataanalysis/data_analysis.py 44% 🟢
src/pai_rag/modules/embedding/multi_modal_embedding.py 64% 🟢
src/pai_rag/modules/intentdetection/intent_detection.py 61% 🟢
src/pai_rag/modules/intentdetection/llm_single_detector.py 77% 🟢
src/pai_rag/modules/intentdetection/output_parser.py 67% 🟢
src/pai_rag/modules/search/search.py 81% 🟢
src/pai_rag/utils/embed_utils.py 26% 🟢
src/pai_rag/utils/oss_client.py 31% 🟢
TOTAL 47% 🟢

Modified Files

File Coverage Status
src/pai_rag/app/api/models.py 100% 🟢
src/pai_rag/core/rag_application.py 44% 🟢
src/pai_rag/core/rag_configuration.py 47% 🟢
src/pai_rag/data/rag_dataloader.py 53% 🟢
src/pai_rag/integrations/llms/dashscope/fc_base.py 100% 🟢
src/pai_rag/integrations/nodes/raptor_nodes_enhance.py 100% 🟢
src/pai_rag/integrations/postprocessor/my_simple_weighted_rerank.py 35% 🟢
src/pai_rag/integrations/readers/llama_parse_reader.py 25% 🟢
src/pai_rag/integrations/readers/markdown_reader.py 23% 🟢
src/pai_rag/integrations/readers/pai_image_reader.py 32% 🟢
src/pai_rag/integrations/readers/pai_pdf_reader.py 78% 🟢
src/pai_rag/integrations/retrievers/fusion_retriever.py 41% 🟢
src/pai_rag/integrations/vector_stores/postgresql/postgresql.py 22% 🟢
src/pai_rag/modules/init.py 100% 🟢
src/pai_rag/modules/agent/agent.py 67% 🟢
src/pai_rag/modules/cache/oss_cache.py 91% 🟢
src/pai_rag/modules/datareader/data_loader.py 91% 🟢
src/pai_rag/modules/datareader/datareader_factory.py 69% 🟢
src/pai_rag/modules/embedding/embedding.py 74% 🟢
src/pai_rag/modules/index/index.py 79% 🟢
src/pai_rag/modules/index/index_utils.py 37% 🟢
src/pai_rag/modules/index/my_vector_store_index.py 29% 🟢
src/pai_rag/modules/index/pai_bm25_index.py 77% 🟢
src/pai_rag/modules/index/store.py 54% 🟢
src/pai_rag/modules/llm/function_calling_llm.py 73% 🟢
src/pai_rag/modules/llm/llm_module.py 72% 🟢
src/pai_rag/modules/llm/multi_modal_llm.py 68% 🟢
src/pai_rag/modules/module_registry.py 96% 🟢
src/pai_rag/modules/queryengine/query_engine.py 56% 🟢
src/pai_rag/modules/retriever/my_vector_index_retriever.py 79% 🟢
src/pai_rag/modules/retriever/retriever.py 53% 🟢
src/pai_rag/modules/synthesizer/synthesizer.py 85% 🟢
src/pai_rag/modules/tool/load_and_search_tool_spec.py 34% 🟢
src/pai_rag/modules/tool/tool.py 52% 🟢
src/pai_rag/modules/tool/utils.py 41% 🟢
src/pai_rag/utils/download_models.py 80% 🟢
src/pai_rag/utils/prompt_template.py 100% 🟢
src/pai_rag/utils/tokenizer.py 100% 🟢
TOTAL 65% 🟢

updated for commit: dda3ed6 by action🐍

@moria97 moria97 merged commit dac813e into main Sep 6, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@moria97 @wwxxzz @aero-xi @zt2645802240 @Ceceliachenen