v1.2.0
🎉🎉🎉QAnything v1.2.0发布!
新特性
- 支持自定义LLM:
- 支持本地LLM和云LLM切换,云LLM支持openai chatgpt API。
- 支持三种LLM推理运行后端,包括FasterTransformer(默认)、huggingface和vllm。
- 通过FastChat Server API支持加载各种开源大语言模型。
- 发布了微调后的千问7B的模型:https://huggingface.co/netease-youdao/Qwen-7B-QAnything
- 修复两个安全漏洞:
- 多个函数中的SQL注入漏洞,漏洞名称:SQL注入 - CWE-89
- LocalFile类中的文件上传漏洞,漏洞名称:文件上传 - CWE-434
- 适配更多显卡:
- 在使用huggingface transformers作为LLM运行后端时,理论上支持Nvidia显卡的计算能力为6.0及以上。
- 更加用户友好:
- 将所有日志文件放在一个目录中,便于调试。
- 添加了一些启动提示信息。
- 其他更新
更新内容
- 支持QAnything中的公共LLM和OpenAI API作为LLM服务。由 @songkq 在 #78 中贡献
- 提供了QAnything启动命令和LLM接口的详细使用方法。由 @songkq 在 #78 中贡献
- 修复了SQL注入和文件名注入的安全漏洞。由 @xixihahaliu 在 #76 中贡献
- 优化日志信息显示,便于调试。由 @xixihahaliu 在 #76 中贡献
- 添加了一些启动提示信息。由 @xixihahaliu 在 #77 中贡献
- 修复: 上传失败时提示失败。由 @dongfeng3692 在 #72 中贡献
- 更新最大上传文件大小的注释 由 @dongfeng3692 在 https://github.com/netease-youdao/QAnything/pull/71中贡献
- 修复: 在windows下使用git bash运行 by @yorelog 在 https://github.com/netease-youdao/QAnything/pull/61中贡献
- linux 1. 解决网络不通导致npm安装异常问题 2. 解决swagger外网拉取慢的问题 由 @01000100GT 在 https://github.com/netease-youdao/QAnything/pull/69中贡献
新贡献者
- @xixihahaliu 在 #76 中首次贡献
- @songkq 在 #78 中首次贡献
- @mvlttt 报告了关于SQL注入和文件名注入的两个安全漏洞
- @dongfeng3692 在 #72 中首次贡献
- @01000100GT 在 #69 中首次贡献
完整变更记录: v1.1.1...v1.2.0
🎉🎉🎉QAnything v1.2.0 released!
What's New
- Custom LLMs is supported:
- Local LLMs and cloud LLMs switching is supported, cloud LLMs support openai chatgpt API.
- Supports three LLM inference runtime backends, include FasterTransformer(default), huggingface and vllm.
- Supports loading various public large language models via the FastChat Server API.
- Our finetuned Qwen 7B model is released at https://huggingface.co/netease-youdao/Qwen-7B-QAnything
- Fixed two security vulnerabilities:
- SQL injection in multiple functions,Vulnerability name: SQL injection - CWE-89
- File upload in LocalFile class, Vulnerability name: File upload - CWE-434
- Adapted for more GPUs:
- Theoretically supports Nvidia GPUs with a compute capability of 6.0 and above when using huggingface transformers as the LLM runtime backend.
- More user-friendly :
- Put all log files in one directory for easy debugging.
- Add some startup prompt messages.
- The front-end page will return results in a streaming manner.
- Other updates
What's Changed
- Support public LLMs and OpenAI API as a LLM service in QAnything. by @songkq in #78
- Provide a detailed usage of QAnything Startup Command and LLM interface. by @songkq in #78
- Fix security vulnerabilities of SQL injection and file name injection. by @xixihahaliu in #76
- Optimize log information display for easier debugging. by @xixihahaliu in #76
- Add some startup prompt messages. by @xixihahaliu in #77
- fix: display upload failure when upload fails by @dongfeng3692 in #72
- Update request max size code annotation by @dongfeng3692 in #71
- fix: running with git bash under windows by @yorelog in #61
- linux 1. Solve the problem that the npm installation is abnormal due to network failure 2. Fix the problem of slow swagger external network pulling by @01000100GT in #69
New Contributors
- @xixihahaliu made their first contribution in #76
- @songkq made their first contribution in #78
- @mvlttt report two security vulnerabilities about SQL injection and file name injection
- @dongfeng3692 made their first contribution in #72
- @01000100GT made their first contribution in #69
Full Changelog: v1.1.1...v1.2.0