You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/plugins/intel_gpu/docs/dynamic_shape/in_memory_cache.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,7 +11,7 @@ When creating a primitive_impl in the Dynamic Shape model, if each primitive_imp
11
11
*`ImplementationsCache` inherits LruCacheThreadSafe which is ThreadSafe version of LruCache which handles primitive_impl cache by increasing the cache hit rate for frequently used items. Therefore, `ImplementationsCache` optimizes the performance of dynamic execution through frequently used primitive_impl.
12
12
* Since cldnn::program creates ImplementationsCache as unique_ptr at `cldnn::program `constructor, its lifecycle is set to `cldnn::program`.
13
13
*`ImplementationsCache` supports multi-stream, so the cldnn::network of each stream manages primitive_impl in same cache.
14
-
*`ImplementationsCache` Capacity is set to 10000 by default, but may change in the future optimization.
14
+
*`ImplementationsCache` Capacity is set to 300 by default, but may change in the future optimization.
0 commit comments