[Trainer] fix distdataloader

[DesmonDay]

PR types

Bug fixes

PR changes

Others

Description

1. Fix distdataloder when using tp;
2. Fix eval under data parallel group.

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 55.43%. Comparing base (9146c1e) to head (e55fae8).
Report is 6 commits behind head on develop.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #8420      +/-   ##
===========================================
- Coverage    55.43%   55.43%   -0.01%     
===========================================
  Files          616      616              
  Lines        96229    96241      +12     
===========================================
+ Hits         53346    53348       +2     
- Misses       42883    42893      +10     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[wawltor]

LGTM