[BACKPORT][BUGFIX][FEATURE] Add oneDNN 1D and 3D deconvolution support and fix bias

[PawelGlomski-Intel]

Description

Backport of #20107 and #20137

Currently, deconvolution 2D is implemented with oneDNN convolution primitives. Deconvolution forward pass is implemented with convolution backward primitives that do not include bias. This requires you to manually add the bias, which is currently broken (#19768).

This change implements oneDNN deconvolution primitives to deconvolution, fixing (#19768).
As I couldn't reproduce (#12579) for the 2D case, I enabled the 2D part of this test.

Adds Deconvolution 1D and 3D support with MKLDNN #19904

Checklist

Essentials

• PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
• Changes are complete (i.e. I finished coding on this PR)
• All changes have test coverage
• Code is well-documented

Changes

• Implemented oneDNN deconvolution primitives to deconvolution (resolves MaskRCNN deconv layer does not really use the bias #19768)
• Added Deconvolution 3D and 1D support with oneDNN (resolves 3D Deconvolution CPU support #19904)
• Fixed flaky deconvolution test (resolves test_mkldnn.test_Deconvolution failed in CI #12579)
• Added native support for Deconvolution 3D
  • Broken down the backward pass of convolution into primitives

[mxnet-bot]

Hey @PawelGlomski-Intel , Thanks for submitting the PR
All tests are already queued to run once. If tests fail, you can trigger one or more tests again with the following commands:

• To trigger all jobs: @mxnet-bot run ci [all]
• To trigger specific jobs: @mxnet-bot run ci [job1, job2]

---

CI supported jobs: [miscellaneous, edge, windows-cpu, unix-cpu, unix-gpu, website, windows-gpu, centos-cpu, clang, sanity, centos-gpu]

---

Note:
Only following 3 categories can trigger CI :PR Author, MXNet Committer, Jenkins Admin.
All CI tests must pass before the PR can be merged.

[PawelGlomski-Intel]

@mxnet-bot run ci [centos-gpu, unix-cpu, unix-gpu, windows-cpu]

[mxnet-bot]

Jenkins CI successfully triggered : [unix-cpu, centos-gpu, unix-gpu, windows-cpu]

[PawelGlomski-Intel]

@mxnet-bot run ci [unix-cpu]

[mxnet-bot]

Jenkins CI successfully triggered : [unix-cpu]

[PawelGlomski-Intel]

@mxnet-bot run ci [unix-cpu]

[mxnet-bot]

Jenkins CI successfully triggered : [unix-cpu]

[bartekkuncer]

LGTM

[PawelGlomski-Intel]

@szha can you preview review?

[szha]

thanks for the forward-port. Could you help make sure that the functionality is tested from the mx.npx module instead of from the legacy Symbol API?

[PawelGlomski-Intel]

@mxnet-bot run ci [miscellaneous, website]

[mxnet-bot]

Jenkins CI successfully triggered : [website, miscellaneous]

[PawelGlomski-Intel]

@szha Can you please review (excluding mkldnn files)?

[szha]

@PawelGlomski-Intel thank you!