-
Notifications
You must be signed in to change notification settings - Fork 137
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
remove v0.7.0 warning #788
Conversation
f'8*batch_size if batch_size is not None, otherwise 64. Prior to ' + | ||
f'Streaming v0.7.0, `predownload` defaulted to ' + | ||
f'max(batch_size, 256 * batch_size // num_canonical_nodes).') | ||
f'8*batch_size if batch_size is not None, otherwise 64.') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we shoudl lower to logger.info
@@ -671,8 +669,7 @@ def _set_shuffle_block_size(self, world: World): | |||
if not world.worker_of_rank: | |||
logger.warning(f'Because `shuffle_block_size` was not specified, it will ' + | |||
f'default to max(4_000_000 // num_canonical_nodes, 1 << 18) if ' + | |||
f'num_canonical_nodes is not None, otherwise 262144. Prior to ' + | |||
f'Streaming v0.7.0, `shuffle_block_size` defaulted to 262144.') | |||
f'num_canonical_nodes is not None, otherwise 262144.') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we should lower to logger.info
f'be equal to physical nodes. Prior to Streaming ' + | ||
f'v0.7.0, `num_canonical_nodes` defaulted to 64 * physical ' + | ||
f'nodes.') | ||
f'be equal to physical nodes.') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we should lower to logger.info
f'be equal to physical nodes. Prior to Streaming ' + | ||
f'v0.7.0, `num_canonical_nodes` defaulted to 64 * physical ' + | ||
f'nodes.') | ||
f'be equal to physical nodes.') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we should lower to logger.info
Closing in favor of #799 |
Description of changes:
remove part of the warning messages about v0.7.0 of streaming.
Issue #, if available:
Merge Checklist:
Put an
x
without space in the boxes that apply. If you are unsure about any checklist, please don't hesitate to ask. We are here to help! This is simply a reminder of what we are going to look for before merging your pull request.General
Tests
pre-commit
on my change. (check out thepre-commit
section of prerequisites)