[AutoNLP]optimize log #5021
[AutoNLP]optimize log #5021
Conversation
|
Thanks for your contribution! |
| @@ -156,25 +156,6 @@ def on_evaluate(self, args, state, control, **kwargs): | |||
| if self.tune.is_session_enabled() and metrics is not None and isinstance(metrics, dict): | |||
| self.session.report(metrics) | |||
|
|
|||
| # report session metrics to Ray to track trial progress | |||
| def on_epoch_end(self, args, state, control, **kwargs): | |||
There was a problem hiding this comment.
on_epoch_end 应该会返回一些训练方面的东西，例如loss, iter/s之类的训练指标，可以再看看
There was a problem hiding this comment.
看起来trainer.py中on_epoch_end没有传入metrics，所以这个函数无法report任何东西
https://github.com/PaddlePaddle/PaddleNLP/blob/develop/paddlenlp/trainer/trainer.py#L731
| stdout_handler = logging.StreamHandler(sys.stdout) | ||
| stdout_handler.setFormatter(logger.format) | ||
| logger.logger.addHandler(stdout_handler) |
There was a problem hiding this comment.
这样子能把所有的log都显示出来吗？如果可以的话，就太好了
There was a problem hiding this comment.
可以，并且可以区分info error warning
There was a problem hiding this comment.
再确认以下几个case:
- verbosity >0的时候，notebook里有log, 文件里有log
- verbosity =0的时候, notebook里没有log, 但是文件里还是有log
| @@ -156,25 +156,6 @@ def on_evaluate(self, args, state, control, **kwargs): | |||
| if self.tune.is_session_enabled() and metrics is not None and isinstance(metrics, dict): | |||
| self.session.report(metrics) | |||
|
|
|||
| # report session metrics to Ray to track trial progress | |||
| def on_epoch_end(self, args, state, control, **kwargs): | |||
There was a problem hiding this comment.
on_epoch_end 应该会返回一些训练方面的东西，例如loss, iter/s之类的训练指标，可以再看看
Codecov Report
@@ Coverage Diff @@
## develop #5021 +/- ##
===========================================
+ Coverage 48.40% 48.41% +0.01%
===========================================
Files 454 454
Lines 65390 65383 -7
===========================================
+ Hits 31649 31654 +5
+ Misses 33741 33729 -12
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. |
PR types
Function optimization
PR changes
APIs
Description
将所有logger内容放到train.log中