Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

weight_quantize api support gpu #59090

Merged
merged 10 commits into from
Nov 24, 2023
Merged

weight_quantize api support gpu #59090

merged 10 commits into from
Nov 24, 2023

Commits on Nov 22, 2023

  1. weight quant gpu wint8

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    ef5b846 View commit details
    Browse the repository at this point in the history

  2. fix scale type of weight ony quant

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    2b95077 View commit details
    Browse the repository at this point in the history

  3. fix cpu quant weight

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    941c9e8 View commit details
    Browse the repository at this point in the history

  4. update

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    56dae78 View commit details
    Browse the repository at this point in the history

  5. float scale for weight-only8 gpu quant

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    4b9184b View commit details
    Browse the repository at this point in the history

  6. fix infermeta

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    3ae2825 View commit details
    Browse the repository at this point in the history

  7. fix include

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    af4c02e View commit details
    Browse the repository at this point in the history

  8. add sm70

    @wwbitejotunn
    wwbitejotunn committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    9a913e9 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2023

  1. fixup and andd sm70

    @wwbitejotunn
    wwbitejotunn committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    1ac2c63 View commit details
    Browse the repository at this point in the history

  2. code_style fix

    @wwbitejotunn
    wwbitejotunn committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    eee6974 View commit details
    Browse the repository at this point in the history