Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Closed: Incorrect Branch] [PaddlePaddle Hackathon] Task 70: Add DALI GPU processing for PP-YOLO training #4545

Closed
wants to merge 65 commits into from

Conversation

gbstack
Copy link
Contributor

@gbstack gbstack commented Nov 11, 2021

PR types

New features

PR changes

APIs

Describe

Hi,

This PR adds DALI processing for PP-YOLO training according to Task #4221

Changing COCODataSet to DALICOCODataSet in configuration file configs/datasets/coco_detection.yml will enable DALI preprocessing.

e.g.

TrainDataset:
  !DALICOCODataSet
    image_dir: train2017
    anno_path: annotations/instances_train2017.json
    dataset_dir: /dataset/coco2017
    data_fields: ['image', 'gt_bbox', 'gt_class', 'is_crowd']

And the training command is same as before

python tools/train.py --config configs/ppyolo/ppyolo_r50vd_dcn_1x_coco.yml

Thanks,

heavengate and others added 30 commits July 21, 2021 12:49
* clean code of s2anet

* fix for paddle==2.1.0

* remove debug info

* update comment
* add kitti metric

* clean kitti metric code

* fix kitticars doc

* fix feature model cfgs

* add kitti metric
…Paddle#3844)

* [dev] rbox update2 (PaddlePaddle#3828)

* set lr for 4 card as default, and update

* fix error
* add frame_rate for mot infer video

* add doc of frame_rate for mot video infer, test=document_fix
wangxinxin08 and others added 27 commits August 13, 2021 13:10
…lePaddle#4097)

* modify VOCDataSet and default value of allow_empty

* revert default value of allow_empty (PaddlePaddle#4150)

Co-authored-by: wangguanzhong <jerrywgz@126.com>
* fix operators typo

* fix kitti metric deploy
… removing requirement of all samples shape in one batch need be same)
…RandomFlip, RandomDistort, NormalizeImage and Permute operations
Set use_dali for all batch_transforms.
Apply batch transforms after loading data from DALI pipeline.
Convert image loaded from DALI pipeline to paddle Tensor.
@CLAassistant
Copy link

CLAassistant commented Nov 11, 2021

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
4 out of 13 committers have signed the CLA.

✅ nemonameless
✅ lyuwenyu
✅ jerrywgz
✅ will-jl944
❌ heavengate
❌ zhiboniu
❌ wangxinxin08
❌ ghostxsl
❌ liuhuiCNN
❌ yghstill
❌ YixinKristy
❌ cnn
❌ gbstack


cnn seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

@gbstack gbstack changed the title [PaddlePaddle Hackathon] Task 70: Add DALI GPU processing for PP-YOLO training [Closed: Incorrect Branch] [PaddlePaddle Hackathon] Task 70: Add DALI GPU processing for PP-YOLO training Nov 11, 2021
@gbstack gbstack closed this Nov 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.