Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expanding Experiment Tracking Support #1211

Closed
wants to merge 8 commits into from
Closed

Expanding Experiment Tracking Support #1211

wants to merge 8 commits into from

Conversation

chesterxgchen
Copy link
Collaborator

@chesterxgchen chesterxgchen commented Jan 9, 2023 •
edited
Loading

This PR has the following changes

  1. Add MLFLow Analytics Receiver to stream data MLflow
  2. Add W&B Receiver to stream data to Weights & Biases as example to show how to integrate with a new ML tracking tool
  3. Add LogWriter Interface and Implement MLFlow and W&B Writers to allow user use MLFLow API syntax
  4. Update the README documents
  5. Add Notebook to show one can use Tensorboard API syntax, but register different Experiment tracker such as MLFlow without change code. Similarly for MLFlow and W&B
  6. expand the examples from hello-pt-tb to experiment_tracking, under which there are following examples
    • hello-pt-tb
      • hello-tb
      • hello-tb-mix
    • hello-pt-mlflow
      • hello-mlflow
      • hello-mlflow-mix
    • hello-pt-wandb

@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
Copy link
Collaborator Author

/build

2 similar comments
@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
Copy link
Collaborator Author

/build

1 similar comment
@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
Copy link
Collaborator Author

/build

1 similar comment
@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
Copy link
Collaborator Author

/build

1 similar comment
@chesterxgchen
Copy link
Collaborator Author

/build

@chesterxgchen
add mlflow_sender and examples
1cac08b 
formatting and unit tests fix
2, update tb_receiver.py to ignore events from mlflow
3. add notebook for interactive examples
git basic code working with documentation
update README.md
add buffer to MLFlow Receiver
update README.md

Major update
1) refactory LogWriter
2) add description tags for MLFLow
3) move WandB as examples.
4) write ReadMe for the WandB design

update notebook
@chesterxgchen
format
68a10dd
@chesterxgchen
update README.md
95624b8
@chesterxgchen
rebase from dev
049a6d9
@chesterxgchen
Take feedbacks from demo
d855310 
1, change group name to include job id + group Id, group Id is needed as in simulator mode, the job id = "simulate_job" for both W&B
2. reduce one example hello-mlflow-mix to reduce confusion
3. in MLFLow, the run-name is the prefix, it is now appended with site-name and gorup_id ( dynamic created)
4. in MLFLOw, the tags now add job_id and group_id.
@chesterxgchen
code format
d7ee7a1
@chesterxgchen
1. update both MLFlow and W&B receivers based on the feedbacks.
61e1ece 
2. update readme.
@chesterxgchen
Update Wandb
58b5ac9
@chesterxgchen chesterxgchen mentioned this pull request Feb 22, 2023
Closed
6 tasks
@chesterxgchen chesterxgchen marked this pull request as draft March 6, 2023 18:56
@chesterxgchen
Copy link
Collaborator Author

Close this PR, as new PRs will replace this one

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yanchengnv yanchengnv Awaiting requested review from yanchengnv

@yhwen yhwen Awaiting requested review from yhwen

@holgerroth holgerroth Awaiting requested review from holgerroth

@YuanTingHsieh YuanTingHsieh Awaiting requested review from YuanTingHsieh

@IsaacYangSLA IsaacYangSLA Awaiting requested review from IsaacYangSLA

@nvidianz nvidianz Awaiting requested review from nvidianz

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@chesterxgchen