Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add studio manifest to curated hub class #4527

Open
wants to merge 52 commits into
base: master-jumpstart-curated-hub
Choose a base branch
from
Open

feat: add studio manifest to curated hub class #4527

wants to merge 52 commits into from

Commits on Mar 8, 2024

  1. Add rest of hub data classes

    @jinyoung-lim
    jinyoung-lim committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    c01e548 View commit details
    Browse the repository at this point in the history

  2. Nit changes

    @jinyoung-lim
    jinyoung-lim committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    7963555 View commit details
    Browse the repository at this point in the history

  3. typo

    @jinyoung-lim
    jinyoung-lim committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    66a4f41 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Add a valid hubcontentdocument for testing

    @jinyoung-lim
    jinyoung-lim committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    9453c12 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master-jumpstart-curated-hub' into master-jumpstart-cur… 

    …ated-hub
    @jinyoung-lim
    jinyoung-lim authored Mar 12, 2024
    Configuration menu
    Copy the full SHA
    a0dd44a View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Add Mr.Fu's examples.

    @jinyoung-lim
    jinyoung-lim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    9a3836f View commit details
    Browse the repository at this point in the history

  2. Nit fixes for uri and dependencies (@chrstfu)

    @jinyoung-lim
    jinyoung-lim committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    61bc16d View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Rough parser

    @jinyoung-lim
    jinyoung-lim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    efbac8f View commit details
    Browse the repository at this point in the history

  2. HubContentDocument class

    @jinyoung-lim
    jinyoung-lim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    8e7bc1b View commit details
    Browse the repository at this point in the history

  3. NoneType handle

    @jinyoung-lim
    jinyoung-lim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    2002c05 View commit details
    Browse the repository at this point in the history

  4. Remove unused util function

    @jinyoung-lim
    jinyoung-lim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    279a9c5 View commit details
    Browse the repository at this point in the history

  5. imports fix

    @jinyoung-lim
    jinyoung-lim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    426b328 View commit details
    Browse the repository at this point in the history

  6. Refactor

    @jinyoung-lim
    jinyoung-lim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    48f281a View commit details
    Browse the repository at this point in the history

  7. MaxRun to MaxRuntimeInSeconds

    @jinyoung-lim
    jinyoung-lim committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    9e4e0f7 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. Address some review comments and add unittest cases

    @jinyoung-lim
    jinyoung-lim committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    2fcbc10 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master-jumpstart-curated-hub' into master-jumpstart-cur… 

    …ated-hub
    @jinyoung-lim
    jinyoung-lim authored Mar 18, 2024
    Configuration menu
    Copy the full SHA
    9e13538 View commit details
    Browse the repository at this point in the history

  3. _is_hub_content to non_serializable class attribute. Fix unit tests.

    @jinyoung-lim
    jinyoung-lim committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    601d6af View commit details
    Browse the repository at this point in the history

  4. ecruri expend regex

    @jinyoung-lim
    jinyoung-lim committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    4ad2ca3 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Merge branch 'master-jumpstart-curated-hub' into master-jumpstart-cur… 

    …ated-hub
    @jinyoung-lim
    jinyoung-lim authored Mar 19, 2024
    Configuration menu
    Copy the full SHA
    2121636 View commit details
    Browse the repository at this point in the history

  2. add regions for hubcontentdocument. lint

    @jinyoung-lim
    jinyoung-lim committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    86467e9 View commit details
    Browse the repository at this point in the history

  3. Add HubNotebookDocument

    @jinyoung-lim
    jinyoung-lim committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    f8fc77e View commit details
    Browse the repository at this point in the history

  4. adding instance type variants for hub models

    @bencrabtree
    bencrabtree committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    151f032 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. Merge branch 'master-jumpstart-curated-hub' into master-jumpstart-cur… 

    …ated-hub
    @jinyoung-lim
    jinyoung-lim authored Mar 20, 2024
    Configuration menu
    Copy the full SHA
    3cebc2e View commit details
    Browse the repository at this point in the history

  2. lint

    @jinyoung-lim
    jinyoung-lim committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    bf00090 View commit details
    Browse the repository at this point in the history

  3. Remove duplicate HubContentSummary type. Fix required and optional va… 

    …ls. Fix unit tests.
    @jinyoung-lim
    jinyoung-lim committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    ca7fcff View commit details
    Browse the repository at this point in the history

  4. Add naming convention type case conversion unit tests

    @jinyoung-lim
    jinyoung-lim committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    d8b0e6a View commit details
    Browse the repository at this point in the history

  5. Add hub model document from json obj unit test

    @jinyoung-lim
    jinyoung-lim committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    0cace86 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Convert json_obj keys to snakecase for hubcontents

    @jinyoung-lim
    jinyoung-lim committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    967b78f View commit details
    Browse the repository at this point in the history

  2. revert unrelated changes

    @jinyoung-lim
    jinyoung-lim committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    193c4a5 View commit details
    Browse the repository at this point in the history

  3. fix logic for s3 output config

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    4be5200 View commit details
    Browse the repository at this point in the history

  4. feat: instance specific jumpstart host requirements (aws#4397) 

    * feat: instance specific jumpstart host requirements

* chore: add js support for copies resource requirement, enforce coupling with ResourceRequirements class

* fix: typing

* fix: pylint
    @evakravi @bencrabtree
    evakravi authored and bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    4411f4c View commit details
    Browse the repository at this point in the history

  5. feat: support JumpStart proprietary models (aws#4467) 

    * feat: add proprietary manifest/specs parsing

add unittests for test_cache

small refactoring

address comments and more unittests

fix linting and fix more tests

fix: pylint

feat: JumpStartModel class for prop models

* remove unused imports and fix docstyle

* fix: remove unused args

* fix: remove unused args

* fix: more unused vars

* fix: slow tests

* fix: unittests

* added more tests to cover some lines

* remove estimator warn check

* chore: address comments re performance

* fix: address comments

* complete list experience and other fixes

* fix: pylint

* add doc utils and fix pylint

* fix: docstyle

* fix: doc

* fix: default payloads

* fix: doc and tags and enums

* fix: jumpstart doc

* rename to open_weights and fix filtering

* update filter name

* doc update

* fix: black

* rename to proprietary model and fix unittests

* address comments

* fix: docstyle and flake8

* address more comments and fix doc

* put back doc utils for future refactoring

* add prop model title in doc

* doc update

---------

Co-authored-by: liujiaor <128006184+liujiaorr@users.noreply.github.com>
    @Captainia @liujiaorr @bencrabtree
    2 people authored and bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    3eb2dc4 View commit details
    Browse the repository at this point in the history

  6. feat: add hub and hubcontent support in retrieval function for jumpst… 

    …art model cache (aws#4438)
    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    ea5bb5a View commit details
    Browse the repository at this point in the history

  7. feat: jsch jumpstart estimator support (aws#4439)

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    7732979 View commit details
    Browse the repository at this point in the history

  8. Master jumpstart curated hub (aws#4464)

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    4eaf7b0 View commit details
    Browse the repository at this point in the history

  9. add hub_arn support for accept_types, content_types, serializers, des… 

    …erializers, and predictor (aws#4463)
    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    fbed0fc View commit details
    Browse the repository at this point in the history

  10. feature: JumpStart CuratedHub class creation and function definitions (… 

    …aws#4448)
    @jinyoung-lim @bencrabtree
    jinyoung-lim authored and bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    f4c72ca View commit details
    Browse the repository at this point in the history

  11. MultiPartCopy with Sync Algorithm (aws#4475) 

    * first pass at sync function with util classes

* adding tests and update clases

* linting

* file generator class inheritance

* lint

* multipart copy and algorithm updates

* modularize sync

* reformatting folders

* testing for sync

* do not tolerate vulnerable

* remove prints

* handle multithreading progress bar

* update tests

* optimize function and add hub bucket prefix

* docstrings and linting
    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    8af63e6 View commit details
    Browse the repository at this point in the history

  12. rebase with master

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    1ac895d View commit details
    Browse the repository at this point in the history

  13. bad rebase

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    2585357 View commit details
    Browse the repository at this point in the history

  14. update lsearchkeyword tags

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    46f017c View commit details
    Browse the repository at this point in the history

  15. add todo comment

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    f6a12ff View commit details
    Browse the repository at this point in the history

  16. saving progress to push to branch

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    ea73f03 View commit details
    Browse the repository at this point in the history

  17. update to remove null values

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    936fb75 View commit details
    Browse the repository at this point in the history

  18. more null values

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    ab08f49 View commit details
    Browse the repository at this point in the history

  19. removing icon uri

    @bencrabtree
    bencrabtree committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    2f22365 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. Add studio manifest to curated hub class

    @dewan-c
    dewan-c committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    277c4f1 View commit details
    Browse the repository at this point in the history

  2. Ran formatter

    @dewan-c
    dewan-c committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    0122251 View commit details
    Browse the repository at this point in the history

  3. Updated naming

    @dewan-c
    dewan-c committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    b8d13b0 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Extract task field from manifest description

    @dewan-c
    dewan-c committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    87a495d View commit details
    Browse the repository at this point in the history

  2. Ran formatter

    @dewan-c
    dewan-c committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    3065bfa View commit details
    Browse the repository at this point in the history

  3. Refactored method

    @dewan-c
    dewan-c committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    3a951e4 View commit details
    Browse the repository at this point in the history