You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
From the current spec, it's unclear where GPU related states are stored (are they on MLCommandEncoder, or MLGraph itself).
I'd agree the spec should improve in this area.
AFAIK, for GPU context, MLContext should maintain a reference to GPU device, MLGraphBuilder created from GPU MLContext should also refer to GPU device to create and compile GPU operators, MLGraph should maintain the compiled GPU operators and persistent/constant GPU resources, MLCommandEncoder should create the command list from GPU device and record operators initialization and compute commands.
@wchao1115 should know more details than me, please feel free to chime in.
The text was updated successfully, but these errors were encountered:
Split from #341, where @wacky6 mentioned
I'd agree the spec should improve in this area.
AFAIK, for GPU context,
MLContext
should maintain a reference to GPU device,MLGraphBuilder
created from GPUMLContext
should also refer to GPU device to create and compile GPU operators,MLGraph
should maintain the compiled GPU operators and persistent/constant GPU resources,MLCommandEncoder
should create the command list from GPU device and record operators initialization and compute commands.@wchao1115 should know more details than me, please feel free to chime in.
The text was updated successfully, but these errors were encountered: