[Create-Workload Enhancements] Rearchitect Create-Workload Feature#609

Merged

IanHoang merged 20 commits intoopensearch-project:mainfrom IanHoang:create-workload-v2-updated

Aug 9, 2024

+681-594

Commits on Aug 5, 2024

Create-Workload V2: Separate workload_generator components
Ian Hoang
committed
Add corpus_extractor.py
Ian Hoang
committed
Create Workload V2: Move extractors to single module and add SynchronousCorpusExtractor
Ian Hoang
committed
Create-Workload V2: Updates Further Refactoring
Ian Hoang
committed
Refine custom workload generator and complete workload creation code
Ian Hoang
committed
Working changes with fixes
Ian Hoang
committed
Minor changes and renames back to number of docs
Ian Hoang
committed
Deprecate legacy workload_generator.py, corpus.py, and index.py
Ian Hoang
committed
Rename SynchronousCorpusExtractor to SequentialCorpusExtractor to be more apt
Ian Hoang
committed
Renamed custom_workload_generator.py to workload_generator.py
Ian Hoang
committed
Update import path to be accurate
Ian Hoang
committed
Refactor tests
Ian Hoang
committed
Remove commented out data class
Ian Hoang
committed
Revise workload_generator.py and move helper functions to helpers.py
Ian Hoang
committed
Add Licenese to new files
Ian Hoang
committed
Address pylint issues
Ian Hoang
committed
Add pylint disable comment for helper tests
Ian Hoang
committed
Add changes based on feedback
Ian Hoang
committed
Address lint issues
Ian Hoang
committed

Commits on Aug 8, 2024

Rename is_valid() to is_valid_index() in extractors.py and update comment based on feedback
Ian Hoang
committed