The Simulator!

[snarayan21]

Description of changes:

Adding a simulator for streaming. New features added:

• handles multiple streams and the associated params
• supports all features of StreamingDataset
• parsing MosaicML training yaml files of all types currently in use
• shuffle quality analysis
• cache limit analysis
  Further information about the features of the simulator are in the readme file at streaming/simulation.

This new series of commits also includes an extensive refactoring of the code to make it more modular, understandable, and extensible down the road. Typing and docstrings are also added.

Issue #, if available:

Simulator story: https://mosaicml.atlassian.net/browse/STR-123

Merge Checklist:

Put an x without space in the boxes that apply. If you are unsure about any checklist, please don't hesitate to ask. We are here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

• I have read the contributor guidelines
• This is a documentation change or typo fix. If so, skip the rest of this checklist.
• I certify that the changes I am introducing will be backward compatible, and I have discussed concerns about this, if any, with the MosaicML team.
• I have updated any necessary documentation, including README and API docs (if appropriate).

Tests

• I ran pre-commit on my change. (check out the pre-commit section of prerequisites)
• I have added tests that prove my fix is effective or that my feature works (if appropriate).
• I ran the tests locally to make sure it pass. (check out testing)
• I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes.

[karan6181]

LGTM. Thank You!