Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kubeflow pipeline artifact visualization #4282

Closed
Dhaval08 opened this issue Jul 28, 2020 · 5 comments
Closed

Kubeflow pipeline artifact visualization #4282

Dhaval08 opened this issue Jul 28, 2020 · 5 comments
Assignees
Labels
area/components area/sdk kind/question lifecycle/stale The issue / pull request is stale, any activities remove this label.

Comments

@Dhaval08
Copy link

Dhaval08 commented Jul 28, 2020

What steps did you take:

I am trying to visualize artifacts for Pipeline runs.
Following is what I write to mlpipeline-ui-metadata.json

metadata = {
    'outputs': [{
        'type': 'markdown',
        'source': 'artifact.md',
    }]
}

I read that the supported source locations are http, https, Amazon S3, Minio, and Google Cloud Storage. Is there any way to use local file system as source for artifact visualization? If not, is there any work around to this? My training code simply writes certain files (like markdown or tensorboard logs) to local file system and I would like to visualize them on Kubeflow dashboard.

What happened:

Artifact tab is not loading any artifact

@Ark-kun
Copy link
Contributor

Ark-kun commented Aug 4, 2020

Please try the following:

metadata = {
    'outputs': [{
        'type': 'markdown',
        'source': 'your *markdown* here',
        'storage': 'inline',
    }]
}

P.S. @Bobgy I think resolving the following issues will make this significantly easier for the users:
#3970
#3510

@Dhaval08
Copy link
Author

Dhaval08 commented Aug 4, 2020

@Ark-kun
Thank you.
I was trying to give the local filesystem path as the source. Giving as S3 path worked for me. Any update on supporting local path as source for these artifacts?

Also, does Kubeflow support real time visualization of tensorboard logs? I did try out the steps from documentation. However, the visualization seems to get created only after the job has finished its execution.
Thank you.

@Bobgy
Copy link
Contributor

Bobgy commented Aug 5, 2020

There cannot be support for local. Do you mean volume?

@stale
Copy link

stale bot commented Nov 5, 2020

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the lifecycle/stale The issue / pull request is stale, any activities remove this label. label Nov 5, 2020
@stale
Copy link

stale bot commented Feb 8, 2021

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

@stale stale bot closed this as completed Feb 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/components area/sdk kind/question lifecycle/stale The issue / pull request is stale, any activities remove this label.
Projects
None yet
Development

No branches or pull requests

3 participants