Skip to content

v1.2.0

Compare
Choose a tag to compare
@successren successren released this 30 Jan 09:12
· 221 commits to master since this release
400df87

🎉🎉🎉QAnything v1.2.0发布!

新特性

  • 支持自定义LLM:
    • 支持本地LLM和云LLM切换,云LLM支持openai chatgpt API。
    • 支持三种LLM推理运行后端,包括FasterTransformer(默认)、huggingface和vllm。
    • 通过FastChat Server API支持加载各种开源大语言模型。
    • 发布了微调后的千问7B的模型:https://huggingface.co/netease-youdao/Qwen-7B-QAnything
  • 修复两个安全漏洞:
    • 多个函数中的SQL注入漏洞,漏洞名称:SQL注入 - CWE-89
    • LocalFile类中的文件上传漏洞,漏洞名称:文件上传 - CWE-434
  • 适配更多显卡:
    • 在使用huggingface transformers作为LLM运行后端时,理论上支持Nvidia显卡的计算能力为6.0及以上。
  • 更加用户友好:
    • 将所有日志文件放在一个目录中,便于调试。
    • 添加了一些启动提示信息。
  • 其他更新

更新内容

新贡献者

完整变更记录: v1.1.1...v1.2.0

🎉🎉🎉QAnything v1.2.0 released!

What's New

  • Custom LLMs is supported:
    • Local LLMs and cloud LLMs switching is supported, cloud LLMs support openai chatgpt API.
    • Supports three LLM inference runtime backends, include FasterTransformer(default), huggingface and vllm.
    • Supports loading various public large language models via the FastChat Server API.
    • Our finetuned Qwen 7B model is released at https://huggingface.co/netease-youdao/Qwen-7B-QAnything
  • Fixed two security vulnerabilities:
    • SQL injection in multiple functions,Vulnerability name: SQL injection - CWE-89
    • File upload in LocalFile class, Vulnerability name: File upload - CWE-434
  • Adapted for more GPUs:
    • Theoretically supports Nvidia GPUs with a compute capability of 6.0 and above when using huggingface transformers as the LLM runtime backend.
  • More user-friendly :
    • Put all log files in one directory for easy debugging.
    • Add some startup prompt messages.
    • The front-end page will return results in a streaming manner.
  • Other updates

What's Changed

  • Support public LLMs and OpenAI API as a LLM service in QAnything. by @songkq in #78
  • Provide a detailed usage of QAnything Startup Command and LLM interface. by @songkq in #78
  • Fix security vulnerabilities of SQL injection and file name injection. by @xixihahaliu in #76
  • Optimize log information display for easier debugging. by @xixihahaliu in #76
  • Add some startup prompt messages. by @xixihahaliu in #77
  • fix: display upload failure when upload fails by @dongfeng3692 in #72
  • Update request max size code annotation by @dongfeng3692 in #71
  • fix: running with git bash under windows by @yorelog in #61
  • linux 1. Solve the problem that the npm installation is abnormal due to network failure 2. Fix the problem of slow swagger external network pulling by @01000100GT in #69

New Contributors

Full Changelog: v1.1.1...v1.2.0