Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add HuggingFace support for automated inference checkpoint conversion #712

Merged
merged 5 commits into from
Jul 11, 2024
Merged

Add HuggingFace support for automated inference checkpoint conversion #712

merged 5 commits into from
Jul 11, 2024

Conversation

vivianrwu
Copy link
Collaborator

@vivianrwu vivianrwu commented Jun 24, 2024 •
edited
Loading

This PR adds the following support:

  1. HuggingFace CLI support in checkpoint conversion script
  2. Checkpoint conversion support for Llama-2, Llama-3, and Gemma models in JetStream Pytorch
  3. Enables quantization checkpoint conversion
  4. Enables tokenizer.model upload to GSBucket
  5. Adds / renames arguments to checkpoint conversion script

@vivianrwu vivianrwu requested a review from liurupeng June 24, 2024 23:33
@vivianrwu vivianrwu changed the title Jet pt hf Add HuggingFace support for automated inference checkpoint conversion Jun 24, 2024
@vivianrwu vivianrwu changed the title Add HuggingFace support for automated inference checkpoint conversion [WIP] Add HuggingFace support for automated inference checkpoint conversion Jun 24, 2024
@liurupeng
Copy link
Collaborator

/gcbrun

@vivianrwu vivianrwu changed the title [WIP] Add HuggingFace support for automated inference checkpoint conversion Add HuggingFace support for automated inference checkpoint conversion Jul 11, 2024
@liurupeng liurupeng enabled auto-merge (squash) July 11, 2024 17:58
@liurupeng
Copy link
Collaborator

/gcbrun

@liurupeng liurupeng merged commit 0fd14fd into GoogleCloudPlatform:main Jul 11, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@liurupeng liurupeng liurupeng approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vivianrwu @liurupeng