Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.14

What's New:

• Optimizations on key-value store support to scale up to 3000 nodes
• New APIs for Allgather, Broadcast and group API calls
• Performance Optimizations for scaleup for Allgather, Allreduce, and Reduce-scatter for scaleup and scaleout
• Performance Optimizations for CPU single node
• Optimizations to reuse Level Zero events.
• Change of the default mechanism for IPC exchange to pidfd

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.13Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.13.1

What's new:

• Bug fixes

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.13

What's New:

• Optimizations to limit the memory consumed by oneCCL
• Optimizations to limit the number of file descriptors maintained opened by oneCCL.
• Align the support for in-place for the Allgatherv and Reduce-scatter collectives to follow the same behavior as NCCL.
• In particular, the Allgatherv collective is in place when:
• send_buff == recv_buff + rank_offset, where rank_offset = sum (recv_counts[i]), for all I<rank.
• Reduce-scatter is in-place when recv_buff == send_buff + rank *recv_count.
• When using the environment variable CCL_WORKER_AFFINITY, oneCCL enforces the requirement that the length of the list should be equal to the number of workers.
• Bug fixes.

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.12

What's New

• Performance improvements for scaleup for all message sizes for AllReduce, Allgather, and Reduce_Scatter.
• Optimizations also include small message sizes that appear in inference apps.
• Performance improvements for scaleout for Allreduce, Reduce, Allgather, and Reduce_Scatter.
• Optimized memory usage of oneCCL.
• Support for PMIx 4.2.6.
• Bug fixes.

Removals

• oneCCL 2021.12 removes support for PMIx 4.2.2

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.11.2

This update provides bug fixes to maintain driver compatibility for Intel® Data Center GPU Max Series.

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.11.1

This update addresses stability issues with distributed Training and Inference workloads on Intel® Data Center GPU Max Series.

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.11

• Added point to point blocking communication operations for send and receive.

• Performance optimizations for Reduce-Scatter.

• Improved profiling with Intel® Instrumentation and Tracing Technology (ITT) profiling level.

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.10

• Improved scaling efficiency of the Scaleup algorithms for ReduceScatter
• Optimized performance of oneCCL scaleup collectives by utilizing the new embedded Data Streaming Accelerator in Intel® 4th Generation Xeon Scalable Processors (formerly code-named Sapphire Rapids)

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.9

• Optimizations across the board including improved scaling efficiency of the Scaleup algorithms for Alltoall and Allgather
• Add collective selection for scaleout algorithm for device (GPU) buffers

Intel(R) oneAPI Collective Communications Library (oneCCL) 2021.8

• Provides optimized performance for Intel® Data Center GPU Max Series utilizing oneCCL.
• Enables support for Allreduce, Allgather, Reduce, and Alltoall connectivity for GPUs on the same node.