Endgame for Iteration Dec. 2019

[leckie-chn]

Feature freeze date: 16 Dec, 2019
Code freeze date: 10:30AM 24 Dec, 2019
Release endgame done: 30 Dec. 2019
Release Manager: @leckie-chn
The original plan is in #1794

Bug Bash

---

Planned Features

• NFS support @chicm-ms
• Kubeflow update adoption @chicm-ms (@SparkSnail help setup env)

more NAS algorithm support

• SPOS @Cjkkkk

more compression algorithm support

• support distill training mode @ultmaster
• Pruning algorithms:
  • L2 pruning @leckie-chn
  • FMreconstruction channel pruning @QuanluZhang
  • network trimming @QuanluZhang
• Quantization algorithms:
  • BNN @chicm-ms

Other Features

• correctly recognize builtin tuner and customized tuner @ultmaster
• logging in dispatcher_base @liuzhe-lz
• nnictl command auto complete @SparkSnail
  only works in source install
• properly catch tuner's error @ultmaster
• Fix local system as remote machine issue @liuzhe-lz

Small changes

• upgrade to the new cuda version for our maintained docker image @liuzhe-lz
• de-duplicate trial configuration in smac tuner (de-duplicate trial configuration in smac tuner #1364 ) @SparkSnail

Doc Completion

---

• SPOS @ultmaster
• BNN @Cjkkkk Doc for quantization #1881
• refactor tuner working directory @chicm-ms

Internal feature

• Philly Training Services @SparkSnail (PR Fri.)