-
Notifications
You must be signed in to change notification settings - Fork 875
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Migrate tutorial-series-get-started-with-flower-pytorch to FDS #2480
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me. I just added some small changes.
@@ -640,9 +620,21 @@ | |||
"toc_visible": true | |||
}, | |||
"kernelspec": { | |||
"display_name": "flower-3.7.12", | |||
"display_name": "flwr-rtwXnbAq-py3.10", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@adam-narozniak just to be sure, is this intended?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
that change probably comes from my side when re-running the notebook. i think this is not important. Can be discarded or kept.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@tanertopal both "display_name" and "name" are required. I changed it to "flwr" now.
When they are not present I get "[E 09:57:23.746 NotebookApp] Notebook JSON is invalid: 'display_name' is a required property". And in UI, when starting the notebook I get the error (if not present). Similarly when "name" was not present in google colab, it complained and defaulted to "python3"
}, | ||
"language_info": { | ||
"codemirror_mode": { | ||
"name": "ipython", | ||
"version": 3 | ||
}, | ||
"file_extension": ".py", | ||
"mimetype": "text/x-python", | ||
"name": "python", | ||
"nbconvert_exporter": "python", | ||
"pygments_lexer": "ipython3", | ||
"version": "3.10.6" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@adam-narozniak do we need this change?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No, we don't need it. Our current nbstripout
removed it. That was added in Javier's run and I didn't notice it.
Issue
The tutorial series uses the custom dataset partitioning which might be implied.
Proposal
Migrate the 1st tutorial to use the Flower Datasets.
Discussion
I've updated the example so the structure remains the same - there is a list of dataloaders. There might be an alternative approach to just create a FederatedDataset abstraction and use it in the client function to fetch a partition, split train test and transform to DataLoader.