Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Add evalutaion scripts for TextNAS #2220

Merged
merged 6 commits into from
Mar 30, 2020
Merged

Conversation

pkuyym
Copy link
Contributor

@pkuyym pkuyym commented Mar 22, 2020

Currently, the reproduction couldn't be guaranteed, will keep polishing this PR.

Since the dataloader changed, we need re-do the hyper-parameter search. The performance of current setting: sst-2: 90.12, sst-5: 53.3

@msftclas
Copy link

msftclas commented Mar 22, 2020

CLA assistant check
All CLA requirements met.

@pkuyym pkuyym changed the title Add evalutaion scripts for TextNAS. Add evalutaion scripts for TextNAS [WIP] Mar 22, 2020
@QuanluZhang QuanluZhang linked an issue Mar 23, 2020 that may be closed by this pull request
@pkuyym pkuyym changed the title Add evalutaion scripts for TextNAS [WIP] Add evalutaion scripts for TextNAS Mar 25, 2020
bn_flag = True
branch_id = self.sample_arc[branch_id]

for operation_id in [0, 1, 2, 3]: # conv_opt
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I notice that this is a LayerChoice but it's not using NNI interface. Theoretically, with NNI, you can share the same model class in search and retrain. Are you having any trouble with that?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Totally agree, it is better to adopt the NNI interface. I need more time to learn the NNI interface and do the adaption.

Copy link
Contributor

@QuanluZhang QuanluZhang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pkuyym please update doc accordingly

@ultmaster ultmaster merged commit c261146 into microsoft:master Mar 30, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add evaluation script for TextNAS
4 participants