Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refinement: setting batch_size for different models #212

Merged
merged 6 commits into from
Mar 11, 2024
Merged

Refinement: setting batch_size for different models #212

merged 6 commits into from
Mar 11, 2024

Commits on Mar 11, 2024

  1. 1. Commented out batch_size for models that don't support this locall… 

    …y 2. If batch_size is not found, use num_thread instead
    @CambioML
    Ribo Yuan authored and CambioML committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    756c690 View commit details
    Browse the repository at this point in the history

  2. fix batch_size logic

    @CambioML
    Ribo Yuan authored and CambioML committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    fb0a2b3 View commit details
    Browse the repository at this point in the history

  3. Formatted the code

    @CambioML
    Ribo Yuan authored and CambioML committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    e2a4c81 View commit details
    Browse the repository at this point in the history

  4. Formatted the code

    @CambioML
    Ubuntu authored and CambioML committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    6d4016f View commit details
    Browse the repository at this point in the history

  5. Update server.py

    @CambioML
    CambioML committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    d8db248 View commit details
    Browse the repository at this point in the history

  6. Update model_config.py

    @CambioML
    CambioML committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    fb01da8 View commit details
    Browse the repository at this point in the history