Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sync 0.10.0 from remote #45

Merged
merged 11 commits into from
Jul 25, 2024
Merged

Sync 0.10.0 from remote #45

merged 11 commits into from
Jul 25, 2024

Commits on Jun 5, 2024

  1. TensorRT-LLM v0.10 update

    * TensorRT-LLM Release 0.10.0
    
    ---------
    
    Co-authored-by: Loki <lokravi@amazon.com>
    Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com>
    3 people authored Jun 5, 2024
    Configuration menu
    Copy the full SHA
    9bd15f1 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2024

  1. Configuration menu
    Copy the full SHA
    2c39687 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    68e36c4 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2024

  1. Configuration menu
    Copy the full SHA
    ad7ef8e View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Configuration menu
    Copy the full SHA
    c5aa6bc View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. fix: use tensorrt 10.1.0

    sangjanai committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    34fa9b1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    32e2eec View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    eec2352 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. fix: synk report fixup (#56)

    Co-authored-by: vansangpfiev <sang@jan.ai>
    vansangpfiev and sangjanai authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    5cf9f82 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Configuration menu
    Copy the full SHA
    e0404ca View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. feat: tiktoken integration (#60)

    * cpp-tiktoken integration init
    
    * remove cpp-tiktoken folder
    
    * tiktoken integration init
    
    * move fmt to third-party dependency
    
    * remove unnecessary option in cortex CMakeLists
    
    * remove unnecessary submodule
    
    * make pcre2 as third-party lib
    
    * fix CI bug build in window
    
    * fix CI bug in linux
    
    * link directory pcre2
    
    * Fix CI bug in linux 'pcre2.h' not found
    
    * Fix bug build static third party lib
    
    * Integate Llama3 successfully
    
    * refactor with model type
    
    * remove unnecessary comment
    
    * format and code convention
    
    * fix logic of mistral when preparing input
    
    * Add remove end_of_text and end_of_turn token feature for llama3
    
    * fix: patch pcre2 CMakeLists.txt file
    
    * fix: do not add fPIC to cpp-tiktoken cmake file
    
    * fix: suppress warnings
    
    * fix: add CMAKE_C_FLAGS
    
    * fix: CI bug build for window in cpp-tiktoken
    
    * fix: CI bug for window fmt build fail without utf-8 flag
    
    * fix: CI bug for window stop using fmt
    
    * fix: build bugs for window - using latest pcre2 third party
    
    * fix: build bugs for window - pcre2 static runtime on
    
    * fix CI bug for window build pcre2
    
    * rename link lib to pcre2-8-static in windows
    
    * fix: use pcre2 dynamic lib for windows
    
    * fix: pack tensorrt_llm_nvrtc_wrapper.dll
    
    * test: only windows
    
    * fix: disable setLoggerFinder for msvc
    
    * fix: cleanup cmake files
    
    * fix: remove fmt
    
    * fix: pack libtensorrt_llm_nvrtc_wrapper
    
    * fix: patches windows
    
    * fix: rm fmt
    
    ---------
    
    Co-authored-by: sangjanai <sang@jan.ai>
    nguyenhoangthuan99 and sangjanai authored Jul 24, 2024
    Configuration menu
    Copy the full SHA
    221c653 View commit details
    Browse the repository at this point in the history