Skip to content

[L0] Enable Batching out of order commands without signal events#1526

Merged
kbenzie merged 15 commits intooneapi-src:mainfrom
nrspruit:event_signal_optional
May 2, 2024
Merged

[L0] Enable Batching out of order commands without signal events#1526
kbenzie merged 15 commits intooneapi-src:mainfrom
nrspruit:event_signal_optional

Conversation

@nrspruit
Copy link
Contributor

  • Given a command being enqueued without dependencies or dependencies outside of a given batch of commands, then signal the event at the end of the command list allowing for parallel execution of the commands.

@nrspruit nrspruit force-pushed the event_signal_optional branch from 2375f0f to 96a860e Compare April 17, 2024 21:43
@github-actions github-actions bot added images UR images level-zero L0 adapter specific issues command-buffer Command Buffer feature addition/changes/specification labels Apr 17, 2024
Copy link
Contributor

@MichalMrozek MichalMrozek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this mode needs to be device specific as for new HW generations we do not want to do this

@nrspruit nrspruit force-pushed the event_signal_optional branch from 0dba278 to 38a8478 Compare April 18, 2024 20:31
@nrspruit nrspruit force-pushed the event_signal_optional branch from 64bf5e3 to a2611ce Compare April 18, 2024 22:48
@nrspruit nrspruit force-pushed the event_signal_optional branch from 44a012f to 6f7f1c1 Compare April 19, 2024 02:36
@nrspruit nrspruit force-pushed the event_signal_optional branch from 6f7f1c1 to 234e8d9 Compare April 19, 2024 02:38
@nrspruit nrspruit force-pushed the event_signal_optional branch from 234e8d9 to dfaceb5 Compare April 19, 2024 15:52
@nrspruit nrspruit force-pushed the event_signal_optional branch from dfaceb5 to 6c9e7ec Compare April 19, 2024 15:56
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
@nrspruit nrspruit force-pushed the event_signal_optional branch from 3c44248 to 6812c82 Compare April 25, 2024 14:12
…xists

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
@nrspruit nrspruit force-pushed the event_signal_optional branch from 686e0b1 to d621b50 Compare April 25, 2024 17:40
@nrspruit nrspruit added the v0.9.x Include in the v0.9.x release label Apr 25, 2024
Copy link
Contributor

@pbalcer pbalcer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just a few minor stylistic comments. I wasn't able to fully follow all the logic, but overall the changes make sense.

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
@pbalcer pbalcer added the ready to merge Added to PR's which are ready to merge label Apr 26, 2024
nrspruit added a commit to nrspruit/llvm that referenced this pull request Apr 26, 2024
- pre-commit PR for oneapi-src/unified-runtime#1526

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Comment on lines +962 to +963
false, NumEventsInWaitList,
EventWaitList, false));
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There isn't a UR wait list for this command-list, it's ordering is enforced by calling Queue->executeCommandList(SignalCommandList, false, false); after the call on line 953

 ZE2UR_CALL(zeCommandQueueExecuteCommandLists,
             (ZeCommandQueue, 1, &CommandBuffer->ZeCommandList, ZeFence));

(see https://github.com/intel/llvm/blob/sycl/sycl/doc/design/CommandGraph.md#level-zero)

@kbenzie kbenzie merged commit f3c5519 into oneapi-src:main May 2, 2024
@kbenzie kbenzie mentioned this pull request May 2, 2024
5 tasks
sarnex pushed a commit to intel/llvm that referenced this pull request May 2, 2024
…13462)

- pre-commit PR for
oneapi-src/unified-runtime#1526

---------

Signed-off-by: Neil R. Spruit <neil.r.spruit@intel.com>
Co-authored-by: Kenneth Benzie (Benie) <k.benzie@codeplay.com>
kbenzie added a commit to kbenzie/unified-runtime that referenced this pull request May 3, 2024
[L0] Enable Batching out of order commands without signal events
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

command-buffer Command Buffer feature addition/changes/specification images UR images level-zero L0 adapter specific issues ready to merge Added to PR's which are ready to merge v0.9.x Include in the v0.9.x release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants