Iteration Plan for Dec 2019

[scarlett2018]

Feature freeze date: 16 Dec, 2019
Code freeze date: 10:30AM 24 Dec, 2019
Release Manager: @leckie-chn
End Game Issue: is tracking in #1872

---

Planned Features

• NFS support (PAI - Dian Wang) (Support NFS storage for PAI Training Service #1635 ) – Support PAILite TrainingService (PAI on NFS) #1848 in review @SparkSnail
• Kubeflow update adoption (investigation) @SparkSnail Added support for kubeflow 0.7 #1814 (resolving conflict)
• [x] Proxyless NAS @QuanluZhang support proxylessnas with NNI NAS APIs #1863

TensorFlow 2.0 support @liuzhe-lz (PR eta. Fri.)

• tensorflow 2.0 (tf.keras) support for NNI NAS interface (Using NNI NAS interface with keras/tf.keras #1737 ) (debugging, eta. Fri.)
• tensorflow 2.0 support for static dynamic graph model compression (depend on Using NNI NAS interface with keras/tf.keras #1737 )
• tensorflow 2.0 test and example (code 2d)

more NAS algorithm support @ultmaster

• SPOS (searching done, debugging for training, splitting PR into 2) Single Path One Shot #1849 Improve Classic NAS mutator #1865
• C-DARTS (to be synced with partner)
• AutoNLP (to be synced author)
  • search algo
• AutoDeepLab (TBD)

more compression algorithm support @Cjkkkk @tanglang96

• support distill training mode @tanglang96 (Knowledge Distillation support #1819 )
• Pruning algorithms: L2 pruning, FMreconstruction channel pruning, network trimming @tanglang96 Add network trimming pruning algorithm and fix bias mask(testing) #1867
• Quantization algorithms: @Cjkkkk add BNN quantization algorithm #1832
  - [ ] separate PR for doc
  - [x] BNN add quantization backward support #1854
  * TTQ (for next release)
  * Trained quantization and weight sharing (TBD)

Pass eslint ( #882 )

• eslint rules investigation ( eslint rules and scan results #1825 ) @chicm-ms
• nni manager eslint:
  • Eslint config and auto fix ( Fix eslint #1831 ) @chicm-ms
  • manual fix ( manually fix eslint #1833 ) @chicm-ms
  • refactor to fix eslint ( Refactor kubernetes training service #1835 ) @chicm-ms
  • enable eslint in pipeline ( Enable eslint for nni_manager #1845 ) @chicm-ms
• Webui eslint
  • Eslint config and fix .ts files ( WebUI eslint configuration #1847 ) @chicm-ms reviewers: @liuzhe-lz @ultmaster
  • fix WebUI *.tsx files eslint and enable @lvybriage [webui] eslint fix  #1864 pending @liuzhe-lz review

Other Features

• tests for supported NAS algorithms (Can nni offer some test metric for the example using one-shot/dart/enas model? #1598 ) @ultmaster (TBD)

• cancel trials in UNKNOWN state (Feature request: UNKNOWN state - ability to cancel trial #1735 ) @chicm-ms (pending, code 1d)

• fabric framework adoption @lvybriage (coding, eta. 20th, Dec)

• BUG - correctly support NaN in metric data, JSON compliant (ValueError: Out of range float values are not JSON compliant #1589 ) @liuzhe-lz (code 1d) @chicm-ms to help profiling.

• correctly recognize builtin tuner and customized tuner @chicm-ms Refactor dispatcher cmdline #1862 (testing on dev-refactor-dispatcher-cmdline)

• logging in dispatcher_base @chicm-ms (bug fix after code freeze)

• nnictl command auto complete @liuzhe-lz

• refactor tuner working directory (doc work) @chicm-ms

• properly catch tuner's error @liuzhe-lz

• Fix local system as remote machine issue How to debug "no machine can be scheduled"? #1852 @chicm-ms PR Fix local system as remote machine issue #1852 #1856 submitted

Documentation

• documentation structure refactor @scarlett2018
  • Readme update Update README.md graph #1860
• customized homepage for sphinx doc build @leckie-chn
• write doc for IPC interface (Write documentation for IPC interface #1741 ) @liuzhe-lz
• update the overview page to explain HPO, NAS, Compression, Feature Engineering @QuanluZhang (update doc: NNI core capacities in Overview.md, standalone mode in Trials.md #1821 )
• add some FAQs about the common network issue that could cause the start failure of restserver (Restful server start failed! #1223 ) @ultmaster @QuanluZhang (Docs improvement: configurations and more #1823 ) resolving conflict
• document improvement of remote mode training service @ultmaster (Docs improvement: configurations and more #1823 )
• improvement of document structure @QuanluZhang @leckie-chn @scarlett2018 (To be reviewed)

Small changes

• upgrade to the new cuda version for our maintained docker image (Support multiple CUDA version in docker images #1748, pending until before release ) @liuzhe-lz
• remove hardcoded call to /usr/bin/python3 in gpu_metrics_collector.sh ( no machine can be scheduled, return TMP_NO_AVAILABLE_GPU  #1712 ) @liuzhe-lz
• de-duplicate trial configuration in smac tuner (de-duplicate trial configuration in smac tuner #1364 ) @QuanluZhang support trial config deduplication in SMAC tuner #1840

Internal feature

• Philly Training Services @SparkSnail (PR Fri.)