Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Hope the pipeline can automatically destroy resources #2498

Open
Volta-lemon opened this issue Sep 23, 2024 · 0 comments
Open

[Feature] Hope the pipeline can automatically destroy resources #2498

Volta-lemon opened this issue Sep 23, 2024 · 0 comments
Assignees

Comments

@Volta-lemon
Copy link

Motivation

I hope the pipeline can automatically manage resource destruction.
Yes, I have taken on this task from the community. However, to my regret, after a period of searching and attempting, I am still unsure where to begin.
I am hoping for some guidance from the community, at least to point me in the right direction of effort.

Supports pipeline resource destruction so that the following test cases can pass

models = [
    'the/path/of/internlm2/model',
    'the/path/of/llama3/model',
    'the/path/of/qwen2/model'
]

prompts = ['hi, shanghai is', 'pls intro yourself']

for model in models:
    pipe = pipeline(model)
    result = pipe(prompts)
    print(result)

Related resources

No response

Additional context

I'm hoping to implement this feature and create a PR, but I'm in dire need of some necessary guidance right now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants