-
Notifications
You must be signed in to change notification settings - Fork 5.6k
2018 01 17
- Inference library installation directory structure: https://github.com/PaddlePaddle/Paddle/pull/7572#pullrequestreview-89201869
- Rename WITH_C_API into PADDLE_BUILD_INFERENCE_LIB: https://github.com/PaddlePaddle/Paddle/issues/7578
- Better directory structure: https://github.com/PaddlePaddle/Paddle/issues/7542
- Read Dockerfile from stdin: https://github.com/PaddlePaddle/Paddle/issues/7502
- Restructure go/api package: https://github.com/PaddlePaddle/Paddle/issues/7496
- Clean up EDL controller: https://github.com/PaddlePaddle/Paddle/issues/7494
- Restructure controller (edl) pacakge: https://github.com/PaddlePaddle/Paddle/issues/7493
- Rename dir controller into edl: https://github.com/PaddlePaddle/Paddle/issues/7492
- Better function register resource type: https://github.com/PaddlePaddle/Paddle/issues/7491
- The imperative programming paradigm: https://github.com/PaddlePaddle/Paddle/issues/7464
- Move content in the buildtools repo into paddle repo: https://github.com/PaddlePaddle/Paddle/issues/7326
- Requiring adding issue to describe PRs:
- https://github.com/PaddlePaddle/Paddle/pull/7605#pullrequestreview-89570801
- https://github.com/PaddlePaddle/Paddle/pull/7606#pullrequestreview-89572298
- https://github.com/PaddlePaddle/Paddle/pull/7597#pullrequestreview-89573043
- https://github.com/PaddlePaddle/Paddle/pull/7573#pullrequestreview-89573885
- PR
- fix display error of C-API doc:
- Update comments for reorder_lod_tansor_by_rank_op and shrink_rnn_memory_op:
- wrapper for element-wise math operators:
- wrapper for l2 normalize: https://github.com/PaddlePaddle/Paddle/pull/7574
- small fix: https://github.com/PaddlePaddle/Paddle/pull/7609
- WIP: prepare dataset for WMT16, and merge it to paddel.dataset
2018-01-18
- fluid distributed performance test and enhancements:
- code coverage update:
- Fluid distributed training
- Support GPU[Merged], https://github.com/PaddlePaddle/Paddle/pull/7537
- Benchamrk design doc[Merged], https://github.com/PaddlePaddle/Paddle/pull/7410
- Split SelectedRows Op[Reviewing], https://github.com/PaddlePaddle/Paddle/pull/7604
- Code Review
- inference:
- compile and install the shared library of fluid inference: https://github.com/PaddlePaddle/Paddle/pull/7572
- a simple independent example project: https://github.com/luotao1/fluid_inference_example
- Intel:
- collect the Intel demand from 2018's 10 aspects: https://github.com/PaddlePaddle/Paddle/issues/7561
- code review: https://github.com/PaddlePaddle/Paddle/pull/7592
- doc:
- add how to update whl in build_from_source.md: https://github.com/PaddlePaddle/Paddle/pull/7471
- add a brief introduction of MKL-DNN work: https://github.com/PaddlePaddle/Paddle/pull/7518
- better directory structure: https://github.com/PaddlePaddle/Paddle/issues/7542
- code review:
- OCR CTC/Attention
- Adapt Warp-CTC grad op for gradient checking
- Add CTC align op
- Add python API for Warp-CTC op
- Restructure im2sequence op
- Add python API for im2sequence op
- Add python wrapper for CTC evaluator[WIP]
- PR review:
- Inference design doc: https://github.com/PaddlePaddle/Paddle/pull/7315
- Inference design, further iteration: https://github.com/PaddlePaddle/Paddle/pull/7315
- Work on paddlepaddle.org:
- Render IO in fluid: https://github.com/PaddlePaddle/Paddle/issues/7335
- Build fails: https://github.com/PaddlePaddle/Paddle/issues/7459
- PR for fixing the rendering the IO file : https://github.com/PaddlePaddle/Paddle/pull/7470
- Add documentation for other functions of IO: https://github.com/PaddlePaddle/Paddle/issues/7495
- Polish executor: https://github.com/PaddlePaddle/Paddle/pull/7499
- Study
Select
case in Go: https://github.com/PaddlePaddle/Paddle/issues/7620 - Will start studying more about Distributed training.
-
Helped fixing CI issue with Helin
-
Helped with CI machine CPU upgrade and new server/rack procurement
-
PR
- https://github.com/PaddlePaddle/Paddle/pull/7469 book chapter 1, distributed version
- https://github.com/PaddlePaddle/Paddle/pull/7619 Fluid dist train guide
-
Issue
- https://github.com/PaddlePaddle/Paddle/issues/7465 Pserver tracking trainer number issue
- https://github.com/PaddlePaddle/Paddle/issues/7627 distributed fluid build issue
- Fix async bugs:https://github.com/PaddlePaddle/Paddle/pull/7435
- code review:
- add image classification distribution version: https://github.com/PaddlePaddle/Paddle/pull/7544
- Implement fluid version of SE-ResNeXt-152
- Implement data augmentation and reader for training with ImageNet
-
Profile the model vgg16 and mnist
-
Update FAQ
https://github.com/PaddlePaddle/Paddle/pull/7584
-
PR Review
Merged PR:
- Add unittests for Parallel.for
Several enhancements:
- https://github.com/PaddlePaddle/Paddle/pull/7453
- https://github.com/PaddlePaddle/Paddle/pull/7587
Survey:
- [Compiler] Halide
- [Cluster] Ray project
- https://github.com/ray-project/ray
- Use ray to construct a pserver/trainer
- [Compiler] TVM
- Doing
Work in process:
-
[Performance Tuning] add performance tuning for parallel.for
-
[BugFix] SparseMatrix.resize()
Profiling:
-
ResNet_cifar10 performance comparison with TensorFlow on cifar10 dataset.
-
[WIP]Fix adagrad op when using GPU.
- Distributed Fluid Framework
- Implement Book chapter 02 in distributed framework https://github.com/PaddlePaddle/Paddle/pull/7629
- Fix send_op https://github.com/PaddlePaddle/Paddle/pull/7625
- [WIP] Move regularization and error clipping to parameter server side https://github.com/PaddlePaddle/Paddle/issues/7432
- Concurrent Programming in Fluid
- Survey concurrent programming paradigms in Go https://talks.golang.org/2012/concurrency.slide#1 https://talks.golang.org/2013/advconc.slide#1
- Add Code of conduct https://github.com/PaddlePaddle/Paddle/pull/7579
- Fixing the rendering for Reduce operators https://github.com/PaddlePaddle/Paddle/pull/7622
- Fix Batch Norm Initialization https://github.com/PaddlePaddle/Paddle/pull/7449
- Fix Block design doc https://github.com/PaddlePaddle/Paddle/pull/7460
- Fix concepts in VarDesc design https://github.com/PaddlePaddle/Paddle/pull/7462
- Code Review
- https://github.com/PaddlePaddle/Paddle/pull/7626#pullrequestreview-89634743
- https://github.com/PaddlePaddle/Paddle/pull/6920#pullrequestreview-89613407
- https://github.com/PaddlePaddle/Paddle/pull/7457#pullrequestreview-88257754
- https://github.com/PaddlePaddle/Paddle/pull/7619#pullrequestreview-89573331
- https://github.com/PaddlePaddle/Paddle/pull/7645#issuecomment-358558862
- EDL clean up
- Concurrent Programming learning and discussion
- Distributed Fluid
- Attend ONNX meeting
- Error clip test on MNIST
- Gradient clip by global norm
- elementwise_max/min op: https://github.com/PaddlePaddle/Paddle/pull/7538
- elementwise op scalar input supporting: https://github.com/PaddlePaddle/Paddle/pull/7593
- gradient clip by global norm: https://github.com/PaddlePaddle/Paddle/pull/7637
- Fixes and updates:
- review a new algorithm from Baidu security lab:
-
paddle
-
VisualDL
https://github.com/PaddlePaddle/VisualDL/pull/87 https://github.com/PaddlePaddle/VisualDL/pull/92 https://github.com/PaddlePaddle/VisualDL/pull/99 https://github.com/PaddlePaddle/VisualDL/pull/100 https://github.com/PaddlePaddle/VisualDL/pull/104 https://github.com/PaddlePaddle/VisualDL/pull/105 https://github.com/PaddlePaddle/VisualDL/pull/115 https://github.com/PaddlePaddle/VisualDL/pull/120 https://github.com/PaddlePaddle/VisualDL/pull/132 https://github.com/PaddlePaddle/VisualDL/pull/133 https://github.com/PaddlePaddle/VisualDL/pull/134 https://github.com/PaddlePaddle/VisualDL/pull/135 https://github.com/PaddlePaddle/VisualDL/pull/136 https://github.com/PaddlePaddle/VisualDL/pull/137 https://github.com/PaddlePaddle/VisualDL/pull/138 https://github.com/PaddlePaddle/VisualDL/pull/139 https://github.com/PaddlePaddle/VisualDL/pull/140 https://github.com/PaddlePaddle/VisualDL/pull/144 https://github.com/PaddlePaddle/VisualDL/pull/150 https://github.com/PaddlePaddle/VisualDL/pull/151 https://github.com/PaddlePaddle/VisualDL/pull/152 https://github.com/PaddlePaddle/VisualDL/pull/156 https://github.com/PaddlePaddle/VisualDL/pull/157 https://github.com/PaddlePaddle/VisualDL/pull/160 https://github.com/PaddlePaddle/VisualDL/pull/161 https://github.com/PaddlePaddle/VisualDL/pull/166 https://github.com/PaddlePaddle/VisualDL/pull/169 https://github.com/PaddlePaddle/VisualDL/pull/171 https://github.com/PaddlePaddle/VisualDL/pull/174
- Decouple ext scorer init & inference & decoding for the convenience of tuning
- Enhance GPU kernel of sequence erase op
- https://github.com/PaddlePaddle/Paddle/pull/7603
- Add python doc for dynamic_lstm
- https://github.com/PaddlePaddle/Paddle/pull/7640
- [WIP] Implement LSTM with projection layer
Code Review:
- enbale auto set env of V1 on Mac
- ctc greedy decoder (align)
- Refine profiler and expose to Python
- Refine vgg16
- add iou similarity operator: https://github.com/PaddlePaddle/Paddle/pull/7566
- Add mine_hard_examples_op(WIP):https://github.com/PaddlePaddle/Paddle/issues/7639
- Discuss with Vision team
- Exposing use_cudnn
- Refine fluid vgg16
- Fix bug - minst.py
- Refine tf mnist
- [WIP]Enhance matmul_op to support 4-D inputs
- Refine conv2d_transpose layer doc
- update:concurrent data transfer and kernel execution
Code Review
- Make elementwise_op supporting scalar input
Y
(#7593) - Refine profiler and expose to Python
- "fix gpu init"
- PR
- Add python wrapper for gated linear unit and split_op:
- Add Python wrapper for dot-product-attention and matmul_op:
- Review
-
Finish training part for fluid's seq2seq
https://github.com/PaddlePaddle/Paddle/pull/7540
https://github.com/PaddlePaddle/Paddle/pull/7517
https://github.com/PaddlePaddle/Paddle/pull/7434
https://github.com/dzhwinter/benchmark/pull/63
https://github.com/dzhwinter/benchmark/pull/58
https://github.com/dzhwinter/benchmark/pull/56 -
Code Review
https://github.com/PaddlePaddle/Paddle/pull/7406#pullrequestreview-88066893
https://github.com/dzhwinter/benchmark/pull/42#pullrequestreview-88738786
https://github.com/PaddlePaddle/Paddle/pull/7521#pullrequestreview-88738707
https://github.com/PaddlePaddle/Paddle/pull/6150#pullrequestreview-88802234
https://github.com/PaddlePaddle/Paddle/pull/4866#pullrequestreview-89319460
- Image
- SSD on Fluid:
- Review the design with other colleagues.
- Issue: https://github.com/PaddlePaddle/Paddle/issues/7488
- Develop bipartite graph match operator. https://github.com/PaddlePaddle/Paddle/issues/7615
- Code Review:
- Add CTC decode: https://github.com/PaddlePaddle/Paddle/pull/7527
- Add python API for warp-ctc op: https://github.com/PaddlePaddle/Paddle/pull/7438
- Adapt warpctc grad op for gradient checking: https://github.com/PaddlePaddle/Paddle/pull/7414
- prior box operator for ssd: https://github.com/PaddlePaddle/Paddle/pulls/wanghaox
- other PRs
- SSD on Fluid:
- Profiling tool:
- Refine profiler and expose to Python: https://github.com/PaddlePaddle/Paddle/pull/7576
- Upgrade pybind and refine pybind/protobuf.cc : https://github.com/PaddlePaddle/Paddle/pull/7563
-
Fluid
-
Mixed Device
- things need to do to complete multi device transform https://github.com/PaddlePaddle/Paddle/issues/7589
- complete data layout transform https://github.com/PaddlePaddle/Paddle/pull/7440
- update switch kernel documentation https://github.com/PaddlePaddle/Paddle/pull/7597
-
machine translation model
-
BUG fix & code optimize
- fix
while_grad_op
first step loss lod problem https://github.com/PaddlePaddle/Paddle/pull/7490 - change DEVICE_TYPE in op_registry to LIBRARY_TYPE https://github.com/PaddlePaddle/Paddle/pull/7588
- Add get set lod for infershape https://github.com/PaddlePaddle/Paddle/pull/7606
- clean
lod_tensor_test
https://github.com/PaddlePaddle/Paddle/pull/7618
- fix
-
Review
- Exposing use_cudnn https://github.com/PaddlePaddle/Paddle/pull/7536
- Bugfix/beamsearch op https://github.com/PaddlePaddle/Paddle/pull/7611
- Fix typo in batch norm bias initialization https://github.com/PaddlePaddle/Paddle/pull/7449
-
-
VisualDL
- release the first version.
https://github.com/PaddlePaddle/VisualDL/pull/114 https://github.com/PaddlePaddle/VisualDL/pull/117 https://github.com/PaddlePaddle/VisualDL/pull/119 https://github.com/PaddlePaddle/VisualDL/pull/125 https://github.com/PaddlePaddle/VisualDL/pull/143 https://github.com/PaddlePaddle/VisualDL/pull/165 https://github.com/PaddlePaddle/VisualDL/pull/168 https://github.com/PaddlePaddle/VisualDL/pull/107 https://github.com/PaddlePaddle/VisualDL/pull/91
- Fluid
- [Update] Add design doc of inference API for fluid
- [issue] How about implement another Run() in framework::Executor
- [Review]
- compile and install the shared library of fluid inference: https://github.com/PaddlePaddle/Paddle/pull/7572#pullrequestreview-89383880
- VisualDL Launch
- added MXNet demo:
- VisualDL website content:
- VisualDL launch communication with Baidu USA Product Team
- VisualDL Docker : https://hub.docker.com/r/daminglu/visualdl_w_mock_data/
- [WIP] PyTorch Demo
-
Inference
- Discussions on the Fluid inference framework design
- Adding feed/fetch ops to programDesc https://github.com/PaddlePaddle/Paddle/pull/7636
- Storing formats https://github.com/PaddlePaddle/Paddle/issues/7580
- Discussions https://github.com/PaddlePaddle/Paddle/pull/7315#discussion_r161934210
- Executor https://github.com/PaddlePaddle/Paddle/issues/7610
-
Document
-
PR review:
Inference:
- Design for input protobuf: https://github.com/PaddlePaddle/Paddle/issues/7580
- Storing format: https://github.com/PaddlePaddle/Paddle/issues/7329
- Discussion about several aspects of inference framework design: - https://github.com/PaddlePaddle/Paddle/issues/7314 - https://github.com/PaddlePaddle/Paddle/issues/7610
PR:
- Batch norm: design doc correction: https://github.com/PaddlePaddle/Paddle/pull/7543
- (won't be pursued further) layer norm: https://github.com/PaddlePaddle/Paddle/pull/7560
- Designed visualdl.paddlepaddle.org
- Started designing summary operator, studied necessary Paddle code for the same
- Initial setup for the visual DL homepage. (https://github.com/PaddlePaddle/PaddlePaddle.org/pull/371)
- Update logos and image assets on VisualDL (https://github.com/PaddlePaddle/PaddlePaddle.org/pull/372)
- Research on Interactive Debugger