Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Convert synchronization dependency to data dependency #26

Closed
wants to merge 1 commit into from

Conversation

JoongunPark
Copy link
Contributor

@JoongunPark JoongunPark commented Feb 29, 2024

Summary

This update is for considering synchronization dependency we can extract from Holistic Trace Analysis (HTA, https://github.com/facebookresearch/HolisticTraceAnalysis)

It uses new input field for Chakra converter, 'sync_dep'.
Required updates are developing on forked repo (https://github.com/JoongunPark/param/tree/refactor)
The updates will be sent as PR to Param (https://github.com/facebookresearch/param) or Taekyung's forked repo (https://github.com/TaekyungHeo/param/tree/refactor)

Test Plan

Command haven't changed.

# Install package from source
$ pip install .

# Run converter 
python3 -m chakra.et_converter.et_converter\
    --input_type PyTorch\
    --input_filename ./result/rank_0.json\
    --output_filename ./result/rank_0.et\
    --num_dims 1

Tested input from Resnet-50 with GTX1070 (rank 0)
rank_0.json

Tested output (Zipped)
rank_0.zip

@JoongunPark JoongunPark requested a review from a team as a code owner February 29, 2024 19:56
Copy link

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@JoongunPark
Copy link
Contributor Author

Close this PR since I made another PR for the later Chakra version.

@github-actions github-actions bot locked and limited conversation to collaborators May 10, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant