Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update MLPerfCallback for v2.1 #1607

Merged
merged 14 commits into from
Oct 11, 2022
Merged

Update MLPerfCallback for v2.1 #1607

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
d43040f
update for bert
hanlint Oct 8, 2022
98e4755
Merge branch 'dev' into hanlin/mlperf_bert
hanlint Oct 9, 2022
584f616
update timing for bert
hanlint Oct 9, 2022
88620ac
Merge branch 'hanlin/mlperf_bert' of github.com:hanlint/composer into…
hanlint Oct 9, 2022
86cc061
only upload if file exists during close()
hanlint Oct 9, 2022
fbab7e8
option to exit when target is met
hanlint Oct 9, 2022
2ff233f
exit at target
hanlint Oct 9, 2022
f8ba5e6
exit at target
hanlint Oct 9, 2022
b49524e
exit at target
hanlint Oct 9, 2022
72b6ecc
fix
hanlint Oct 9, 2022
590f49d
Merge branch 'dev' into hanlin/mlperf_bert
hanlint Oct 11, 2022
cad5c60
fix lint
hanlint Oct 11, 2022
ff9389f
fix
hanlint Oct 11, 2022
97c70ef
Merge branch 'dev' into hanlin/mlperf_bert
hanlint Oct 11, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions composer/callbacks/mlperf.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -320,8 +320,8 @@ def epoch_start(self, state: State, logger: Logger) -> None:

def epoch_end(self, state: State, logger: Logger) -> None:
if _global_rank_zero():
self.mllogger.event(key=constants.EPOCH_STOP, metadata={'epoch_num': self._get_time(state)})
logger.file_artifact(artifact_name=self.upload_name, file_path=self.filename)
self.mllogger.event(key=constants.EPOCH_STOP, metadata={'epoch_num': state.timestamp.epoch.value})
hanlint marked this conversation as resolved.
Show resolved Hide resolved
logger.upload_file(remote_file_name=self.upload_name, file_path=self.filename)

def eval_start(self, state: State, logger: Logger) -> None:
if _global_rank_zero():
Expand Down
You are viewing a condensed version of this merge commit. You can view the full changes here.