Skip to content

Separate Code Generation and Constant Collection during Compile  #2254

Closed
@gcatron

Description

@gcatron

Background:
With the new runtime design (#2045) we split the compilation step into two parts parts, code generation and collecting constants. Code generation is when the graph is converted to executable code that will run on the platform. Collecting Constants is the process of gathering weights and constants from the input module and copying them into a single chunk of memory for execution and copying to the device.

Impact:
This means we need to introduce a new method to the Backend interface. Namely, compileWithoutConstants. This does everything compile does except collect constants to one region of memory.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions