Skip to content

Latest commit

 

History

History
 
 

auto

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
docs
docs
 
 
utils
utils
 
 
CMakeLists.txt
CMakeLists.txt
 
 
README.md
README.md
 
 
async_infer_request.cpp
async_infer_request.cpp
 
 
async_infer_request.hpp
async_infer_request.hpp
 
 
auto_executable_network.cpp
auto_executable_network.cpp
 
 
auto_executable_network.hpp
auto_executable_network.hpp
 
 
auto_schedule.cpp
auto_schedule.cpp
 
 
auto_schedule.hpp
auto_schedule.hpp
 
 
bind_multi_schedule.cpp
bind_multi_schedule.cpp
 
 
bind_multi_schedule.hpp
bind_multi_schedule.hpp
 
 
common.hpp
common.hpp
 
 
executable_network.cpp
executable_network.cpp
 
 
executable_network.hpp
executable_network.hpp
 
 
infer_request.cpp
infer_request.cpp
 
 
infer_request.hpp
infer_request.hpp
 
 
itt.hpp
itt.hpp
 
 
multi_executable_network.cpp
multi_executable_network.cpp
 
 
multi_executable_network.hpp
multi_executable_network.hpp
 
 
multi_schedule.cpp
multi_schedule.cpp
 
 
multi_schedule.hpp
multi_schedule.hpp
 
 
plugin.cpp
plugin.cpp
 
 
plugin.hpp
plugin.hpp
 
 
plugin_config.cpp
plugin_config.cpp
 
 
schedule.hpp
schedule.hpp
 
 

README.md

OpenVINO™ AUTO Plugin

The main responsibility of the AUTO plugin is to provide a unified device that enables developers to code deep learning applications once and deploy them anywhere.

Other capabilities of the AUTO plugin include:

  • Static device selection, which intelligently loads a network to one device or multiple devices.
  • CPU acceleration to start inferencing while the target device is still loading the network.
  • Model priority support for loading multiple networks to multiple devices.

The component is written in C++. If you want to contribute to the AUTO plugin, follow the common coding style rules.

Key contacts

In case of any questions, review and merge requests, contact the AUTO Plugin maintainer group.

Components

The AUTO plugin follows the OpenVINO™ plugin architecture and consists of several main components:

  • docs contains developer documentation for the AUTO plugin.
  • current folder contains sources of the AUTO plugin.

Learn more in the OpenVINO™ Plugin Developer Guide.

Architecture

The diagram below shows an overview of the components responsible for the basic inference flow:

flowchart TD

    subgraph Application["Application"]
    end

    subgraph OpenVINO Runtime["OpenVINO Runtime"]
        AUTO["AUTO Plugin"] --> CPU["CPU Plugin"]
        AUTO["AUTO Plugin"] --> GPU["GPU Plugin"]
    end

    Application --> AUTO

    style Application fill:#6c9f7f
Loading

Find more details in the AUTO Plugin architecture document.

Tutorials

See also