v0.8.1

🚀 Streaming v0.8.1

Streaming v0.8.1 is released! Install via pip:

pip install --upgrade mosaicml-streaming==0.8.1

🔧 Improvements

Dataloader hanging between epochs has now been resolved! We've seen training time improvements of up to 40% for some many-epoch training jobs. If this was impacting your runs and has now been fixed, please let us know!

• Fix dataloader hang at the end of an epoch by @XiaohanZhangCMU in #741
• Add default compression, and warning about local paths to dataframe_to_mds by @srowen in #748
• Throw exception when event.is_set() after write()s by @srowen in #754

🐛 Bug Fixes

• Ensure deterministic sample order between epochs when shuffle=False by @snarayan21 in #750

What's Changed

• Make Pytest log in color in Github Action by @eitanturok in #739
• fix azure container name and blob name in download_from_azure by @jaehwana2z in #733
• Bump uvicorn from 0.30.3 to 0.30.5 by @dependabot in #743
• Update huggingface-hub requirement from <0.24,>=0.23.4 to >=0.23.4,<0.25 by @dependabot in #729
• Bump fastapi from 0.111.1 to 0.112.0 by @dependabot in #744
• Bump ci-testing to v0.1.0 by @snarayan21 in #745
• Patching conf.py due to Sphinx deprecating config manipulation by @snarayan21 in #746
• Bump ci-testing to v0.1.2 by @snarayan21 in #747
• Type hints conformant with pep 585 by @snarayan21 in #752
• Ruff rule to remove unused imports by @snarayan21 in #756
• Fix linting for numpy 2.1.0 by @snarayan21 in #764
• Bump fastapi from 0.112.0 to 0.112.1 by @dependabot in #760
• Bump uvicorn from 0.30.5 to 0.30.6 by @dependabot in #762
• Version 0.8.1 bump! by @snarayan21 in #766

New Contributors

• @eitanturok made their first contribution in #739
• @jaehwana2z made their first contribution in #733
• @srowen made their first contribution in #748

Full Changelog: v0.8.0...v0.8.1