Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CPU]whisper readvalue optimize #26130

Open
wants to merge 96 commits into
base: master
Choose a base branch
from
Open

[CPU]whisper readvalue optimize #26130

wants to merge 96 commits into from
+928 −55

Commits on Aug 19, 2024

  1. Add profiler for CPU plugin. 

    Profile each node execute time.
Support Static and Dynamic infer.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    2916414 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Mark ReadValue's inputs and corresponding Assign. 

    If reset is not called, these marked nodes also desn't need to be executed.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    451c76d View commit details
    Browse the repository at this point in the history

  2. Only mark: ReadValue->Assign pairs. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    137beee View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Optimize pattern match. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    737fe5c View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. transformation test pass. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    6b05005 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Test pass. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    58d9f6f View commit details
    Browse the repository at this point in the history

  2. Fix error: one param link to mulitple ReadValueWithSubgraphNode 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    d54dc25 View commit details
    Browse the repository at this point in the history

  3. Add submodel infer to MemoryInput::runDynamic 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    a533d73 View commit details
    Browse the repository at this point in the history

  4. Debug code

    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    f7339e3 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/master' into xp/whisper_readvalu… 

    …e_optimize
    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    e142a06 View commit details
    Browse the repository at this point in the history

  6. fix merge error

    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    4a2dba0 View commit details
    Browse the repository at this point in the history

  7. Dynamic shape test pass 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    bf7e493 View commit details
    Browse the repository at this point in the history

  8. test whisper pass

    @xipingyan
    xipingyan committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    d90144e View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Disable debug log to test performance. Got expected result: 

    decoder network: 20ms -> 5 ms.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    5a98e7b View commit details
    Browse the repository at this point in the history

  2. Add test.

    @xipingyan
    xipingyan committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    577721d View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Remove stateName in ov::Node 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    c23062e View commit details
    Browse the repository at this point in the history

  2. Add env: ENABLE_RV for comprison test.

    @xipingyan
    xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    592919b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    f134307 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'xp/whisper_readvalue_optimize' of https://github.com/xi… 

    …pingyan/openvino into xp/whisper_readvalue_optimize
    @xipingyan
    xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    258c3c8 View commit details
    Browse the repository at this point in the history

  5. rm debug log

    @xipingyan
    xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    5c771b0 View commit details
    Browse the repository at this point in the history

  6. [CPU] Introduce SubModel op and Composite node 

    with the idea of wrapping up (grouping) parts of the model / graph
into a inner model / graph without any (almost) runtime overhead.
SubModel op and Compoisite node are expected to perform no extra logic
and to only execute an inner model / graph

Apply review comments + update naming of affected code parts

Redesign inplace implementation
    @EgorDuplensky @xipingyan
    EgorDuplensky authored and xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    17b8ce3 View commit details
    Browse the repository at this point in the history

  7. Apply review comments

    @EgorDuplensky @xipingyan
    EgorDuplensky authored and xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    3a6b83a View commit details
    Browse the repository at this point in the history

  8. Merge branch 'egor/introduce_subgraph_node' into xp/whisper_readvalue… 

    …_optimize
    @xipingyan
    xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    f57851d View commit details
    Browse the repository at this point in the history

  9. Integrate SubModel, WIP. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    ca7dde8 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Remove not used variable. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    df7bb70 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Merge remote-tracking branch 'origin/master' into xp/whisper_readvalu… 

    …e_optimize
    @xipingyan
    xipingyan committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    aa33812 View commit details
    Browse the repository at this point in the history

  2. Remove USE_SUBMODEL

    @xipingyan
    xipingyan committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    62772a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Fix search gap. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cebed6f View commit details
    Browse the repository at this point in the history

  2. Tmp version, test integrate new interface of Graph, Init and Activate. 

    Current version doesn't work, cpu node get null buff in subgraph.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d0f7986 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. After calling new interface of graph, fix memory inPlace issue. 

    "resolveInPlaceEdges" must be called in intel_cpu::MemoryInput,
because shared memroy is allocated here,
MemoryOutput is replaced with MemoryOutputStub,
which is fake node, is not executable, and it also not allocate real memory.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    47f436c View commit details
    Browse the repository at this point in the history

  2. remove tmp code

    @xipingyan
    xipingyan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    dbb9a3e View commit details
    Browse the repository at this point in the history

  3. "remove debug log" 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2ed69c0 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Remove profiling code. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    44c8fb2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    87664d4 View commit details
    Browse the repository at this point in the history

  3. Revert unchanged code.

    @xipingyan
    xipingyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    153b4b8 View commit details
    Browse the repository at this point in the history

  4. Simplify codes. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    e188276 View commit details
    Browse the repository at this point in the history

  5. Add judge whether subGraph can be called. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    2833602 View commit details
    Browse the repository at this point in the history

  6. Fix test fail issue: readvalue have no any input. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    0a6f13f View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Remove get_body, m_subgraph, and update haveSubgraph. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7ae318f View commit details
    Browse the repository at this point in the history

  2. Replace set_body with base class set_function 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    79b8272 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. remove debug env

    @xipingyan
    xipingyan committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    9c0989d View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. 1: Add check memoryNode null 

    2: cast to MemoryNode.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    3eaea83 View commit details
    Browse the repository at this point in the history

  2. 1: Remove reset_prime_mem setter 

    2: ReadValueWithSubgraphNode->ReadValueWithSubgraph
3: ReadValueWithSubgraph add new inheritance public ov::op::util::VariableExtension
4: Remove private variable: m_variable;
5: Change MAX_RECURSIVE_DEEP_CHECK_NODE to constexpr
6: Removed: using MemoryInputBase::MemoryInputBase

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    d3bf35c View commit details
    Browse the repository at this point in the history

  3. Remove getSupportedDescriptors in cpp.

    @xipingyan
    xipingyan committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    266cf38 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. 1. Removed const MemoryPtr& prime_mem() const 

    2. MemoryInputBase::isSupportedOperation(op, errorMessage) also should be called.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    e94e67f View commit details
    Browse the repository at this point in the history

  2. 1: Remove redefine supportedPrimitiveDescriptors 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    e5402f8 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    74147b7 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Simply codes. 

    auto assignOp = std::dynamic_pointer_cast<ov::op::util::VariableExtension>(op)

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    8702a13 View commit details
    Browse the repository at this point in the history

  2. 1: Remove semicolon after {} 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    fe6f9b4 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. 1: visit_attributes add variable id info 

    2: remove lambda func: add_node_to_subgraph
3: Updated test. Cover more cases.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    5f14cc2 View commit details
    Browse the repository at this point in the history

  2. Remove is_in_subgraph, use hashset to check if exist. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    a4bc6cd View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. Shorten final_successor_is_only_root to successor_is_root 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    2da8a3a View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Add hashset variable visited to reduce time complexity. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    942a10c View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Take ReadValue Assign pair as stand feature. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    6ce3e63 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Move to MemoryInputSingle 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    ef00d66 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into xp/whisper_readvalu… 

    …e_optimize
    @xipingyan
    xipingyan committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    140862a View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. dynamic test pass. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    f4a9dce View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Remove resolveInPlaceEdges call in the Graph::Allocate. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    afaf42f View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. Add shape inference. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    00da6b7 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into xp/whisper_readvalu… 

    …e_optimize
    @xipingyan
    xipingyan committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    bb006dc View commit details
    Browse the repository at this point in the history

  3. Remove search depth limit. 

    Remove test code.
Revert makeState.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    37bc18f View commit details
    Browse the repository at this point in the history

  4. Update node search function name, make it easy to understand. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    ad2a87a View commit details
    Browse the repository at this point in the history

  5. Initial State doesn't work

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    6ccd217 View commit details
    Browse the repository at this point in the history

  6. Fix transformation

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    f0142fc View commit details
    Browse the repository at this point in the history

  7. Fix isSuitable node check

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    c3db59d View commit details
    Browse the repository at this point in the history

  8. Introduce a Single mode in the MemoryInputBase class

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    0d01e93 View commit details
    Browse the repository at this point in the history

  9. Make MemoryInput strictly non const

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    8403952 View commit details
    Browse the repository at this point in the history

  10. Add single buffer state implementation

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    a34ab0c View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'origin/master' into Drop_Assign

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    7319791 View commit details
    Browse the repository at this point in the history

  12. Add commit call to the MemoryInputSingle

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    dcb3603 View commit details
    Browse the repository at this point in the history

  13. Enable LoRA test with random tensors

    @maxnick
    maxnick committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    2c61fb7 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Clean up LoRA test

    @maxnick
    maxnick committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    ced56d6 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. 1: Merge branch 'maxsim/drop_assgin' into xp/whisper_readvalue_optimize 

    2: Update my implementation;
2.1: Move init_graph to MemoryInput,
2.2: Upgrade memoryinput and MemoryInputBase, let it to suitable to multiple inputs params


Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1074f19 View commit details
    Browse the repository at this point in the history

  2. remove memoryoutputsinglestub 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    dd5dd8a View commit details
    Browse the repository at this point in the history

  3. Removed Assign node check when finding init_graph of ReadValue. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    5e91806 View commit details
    Browse the repository at this point in the history

  4. Let test support Indirect ReadValue Assgin Pair. 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    cf8a18f View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Merge remote-tracking branch 'origin/master' into xp/whisper_readvalu… 

    …e_optimize
    @xipingyan
    xipingyan committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    893888e View commit details
    Browse the repository at this point in the history

  2. Update OutputConfig desc

    @xipingyan
    xipingyan committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    6fe7302 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    2f14480 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Nov 4, 2024
    Configuration menu
    Copy the full SHA
    786c59e View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. 1: Remove InitGraphStatefulModelInplace, ReadValueAssignTest can cove… 

    …r this.

2: Fix ReadValueAssignTest fail issue, just make sure "initOptimalPrimitiveDescriptor" don't change original primitive.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    a998273 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Nov 5, 2024
    Configuration menu
    Copy the full SHA
    4abc1b0 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    5d5ae39 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. create a separate input memory objects instead of share them in subgr… 

    …aph input memory.

avoid data corruption.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    388c72a View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Move subGraph init into MemoryInput::initOptimalPrimitiveDescriptor() 

    Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    d0fb105 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Merge branch 'master' into xp/whisper_readvalue_optimize

    @xipingyan
    xipingyan authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    de904bb View commit details
    Browse the repository at this point in the history

  2. Temporarily skip this pattern. If MemoryInputSDPA supports Subgraph i… 

    …n the future, it may be deleted.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    b621364 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. 1: Remove "using MemoryInputBase::MemoryInputBase;inheritance " 

    2: Adopt parent configuration, avoid to insert reorder before the MemoryInput.
3: move prepare param to runDynamic, because it is not called each time.
    @xipingyan
    xipingyan committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    63bb470 View commit details
    Browse the repository at this point in the history

  2. Remove assignedMem->redefineDesc(... 

    It is responsibility of MemoryInputSingle or MemoryOutput
    @xipingyan
    xipingyan committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    5d6c9de View commit details
    Browse the repository at this point in the history

  3. update: std::shared_ptr<ov::Model> func = nullptr,

    @xipingyan
    xipingyan committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    e2371d5 View commit details
    Browse the repository at this point in the history

  4. Simplify code about ov::optional init. 

    Add: CPU_GRAPH_OPTIMIZER_SCOPE(DropRedundantMemoryOutput_SubGraph);
before create edge, call graph.RemoveEdge(parentEdge);

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    800bca3 View commit details
    Browse the repository at this point in the history

  5. Correct grammar for test description.

    @xipingyan
    xipingyan committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    84cddcd View commit details
    Browse the repository at this point in the history

  6. Recover remove parent edges code, because it will trigger fail for mu… 

    …litply parents edges.

Signed-off-by: xipingya <xiping.yan@intel.com>
    @xipingyan
    xipingyan committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    128e3ab View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2024

  1. Just compare node with pointer, 

    Update comments: // Flag: find Output node
    @xipingyan
    xipingyan committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    5bbf247 View commit details
    Browse the repository at this point in the history

  2. All visited nodes should be flagged.

    @xipingyan
    xipingyan committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    fa3ed85 View commit details
    Browse the repository at this point in the history

  3. Use shared_ptr to wrapper subGraph.

    @xipingyan
    xipingyan committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    1e9a327 View commit details
    Browse the repository at this point in the history