[FFI] part4: npx.embedding, npx.topk, npx.layer_norm, npx.leaky_relu

[barry-jin]

Description

part4 of #20096
Benchmarks
npx.embedding

setup = """
from mxnet import np, npx
npx.set_np()
inp = np.arange(0, 4, dtype=np.int32).reshape(2, 2)
vec = np.ones((4, 32))
"""
stmt = """
out = npx.embedding(inp, vec, 4, 32)
"""
timer = timeit.Timer(setup=setup,
                     stmt=stmt)
num_repeat = 1000
print(min(timer.repeat(repeat=10, number=num_repeat)) / num_repeat)

legacy
0.00011503259599999982
New FFI
7.77029469999997e-05

npx.topk

setup = """
from mxnet import np, npx
npx.set_np()
inp = np.ones((2, 10))
"""
stmt = """
out = npx.topk(inp, k=2, axis=None, ret_typ="indices", is_ascend=False, dtype="float32")
"""
timer = timeit.Timer(setup=setup,
                     stmt=stmt)
num_repeat = 1000
print(min(timer.repeat(repeat=10, number=num_repeat)) / num_repeat)

legacy
0.0001376656030000003
New FFI
7.502453999999981e-05

npx.layer_norm

setup = """
from mxnet import np, npx
npx.set_np()
inp = np.ones((2, 10))
gamma=np.ones((2))
beta=np.zeros((2))
"""
stmt = """
out = npx.layer_norm(inp, gamma=gamma, beta=beta, axis=0, eps=1e5, output_mean_var=False)
"""
timer = timeit.Timer(setup=setup,
                     stmt=stmt)
num_repeat = 1000
print(min(timer.repeat(repeat=10, number=num_repeat)) / num_repeat)

legacy
0.00012714471100000013
New FFI
6.810771400000038e-05

npx.leaky_relu

setup = """
from mxnet import np, npx
npx.set_np()
inp = -1 * mx.np.ones(shape=(2, 10))
"""
stmt = """
out = mx.npx.leaky_relu(inp, act_type="leaky", slope=0.3, lower_bound=0.125, upper_bound=0.334)
"""
timer = timeit.Timer(setup=setup,
                     stmt=stmt)
num_repeat = 1000
print(min(timer.repeat(repeat=10, number=num_repeat)) / num_repeat)

legacy
0.00011906070800000013
New FFI
5.249297100000039e-05

Checklist

Essentials

• PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
• Changes are complete (i.e. I finished coding on this PR)
• All changes have test coverage
• Code is well-documented

Changes

• Feature1, tests, (and when applicable, API doc)
• Feature2, tests, (and when applicable, API doc)

Comments

• If this change is a backward incompatible change, why must this change be made.
• Interesting edge cases to note here

[mxnet-bot]

Hey @barry-jin , Thanks for submitting the PR
All tests are already queued to run once. If tests fail, you can trigger one or more tests again with the following commands:

• To trigger all jobs: @mxnet-bot run ci [all]
• To trigger specific jobs: @mxnet-bot run ci [job1, job2]

---

CI supported jobs: [windows-gpu, unix-gpu, clang, edge, windows-cpu, centos-cpu, website, centos-gpu, unix-cpu, miscellaneous, sanity]

---

Note:
Only following 3 categories can trigger CI :PR Author, MXNet Committer, Jenkins Admin.
All CI tests must pass before the PR can be merged.

[barry-jin]

@mxnet-bot run ci [unix-cpu]

[mxnet-bot]

Jenkins CI successfully triggered : [unix-cpu]