Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BYOC][ETHOSN] Introduce the Ethos-N BYOC integration #6222

Merged
merged 37 commits into from
Aug 19, 2020
Merged

[BYOC][ETHOSN] Introduce the Ethos-N BYOC integration #6222

merged 37 commits into from
Aug 19, 2020

Commits on Aug 13, 2020

  1. [BYOC][ETHOSN] Introduce the Ethos-N BYOC integration 

    This is the first of 3 PRs to introduce the Ethos-N
integration into TVM via the BYOC framework. It adds
support for partitioning and compiling for the
Ethos-N77 target with CPU fallback for unsupported
operators. Additionally, runtime support is added in
the form of an Ethos-N runtime module. In this initial
PR, only quantized concatenate and split are supported
with follow-up PRs adding support for many further operators.


Co-authored-by: Leo Blonk <Leo.Blonk@arm.com>
Co-authored-by: Tristan O'Connor <tristan.oconnor@arm.com>
Co-authored-by: Leandro Nunes <leandro.nunes@arm.com>
Co-authored-by: Ramana Radhakrishnan <ramana.radhakrishnan@arm.com>
Co-authored-by: Luke Hutton <luke.hutton@arm.com>
    @mbaret @Leo-arm
    @tristan-arm @leandron @lhutton1
    6 people committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    628c6a8 View commit details
    Browse the repository at this point in the history

  2. Turn off USE_ETHOSN_HW by default 

    Change-Id: Ie2ce4528e16e93aa83df46f8a229c0ce89b45252
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    a73e524 View commit details
    Browse the repository at this point in the history

  3. Update capabilities file 

    Change-Id: Iebd0c62d6bc7e446662abdee4882ac874ad98aa3
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    e116823 View commit details
    Browse the repository at this point in the history

  4. Fix missing header 

    Change-Id: I0c89e380dd1d795755a1884c06a7b317a99fe297
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    5350901 View commit details
    Browse the repository at this point in the history

  5. Update cmake comments on ETHOSN_HW 

    Change-Id: I2e96a1c818a82e5174fd94e483b0bdb3e4375a7d
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    b69b7a8 View commit details
    Browse the repository at this point in the history

  6. Add checker for case when USE_ETHOSN=OFF and USE_ETHOSN_HW=ON 

    Change-Id: Id5c9cfb866914a0298b44ead40fcbe3764ce443c
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    1d03ac9 View commit details
    Browse the repository at this point in the history

  7. Fix 'available' boolean 

    Change-Id: I78e54fb9f472d2815886bea4d94b7247e0d129de
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    56b3294 View commit details
    Browse the repository at this point in the history

  8. Check availability in op registration 

    Change-Id: Iecfea7dca7301dd684199c9b32f99f2113fdfd56
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    73d70e6 View commit details
    Browse the repository at this point in the history

  9. Remove unnecessary line 

    Change-Id: Idf5cab853027adb0b0292de877e6dc02683821d7
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    01005f8 View commit details
    Browse the repository at this point in the history

  10. Simplify getting output_size 

    Change-Id: If4643924768c2d7ea98525e9f792b7223cc2bcdf
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    175fcdd View commit details
    Browse the repository at this point in the history

  11. Remove unnecessary new line 

    Change-Id: Ia689c59cac28bd91e237ceecd829d8cf56d0d9c1
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    587e4a5 View commit details
    Browse the repository at this point in the history

  12. Remove NOLINTS 

    Change-Id: I149b97b28b516c7d9288a0858b2fbf1497e70250
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    b8acaa6 View commit details
    Browse the repository at this point in the history

  13. Remove unused parts of PR 

    Change-Id: I2db5b89d8fe2c114ab92305cdcf06d0fc45f4d2a
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    2f2a054 View commit details
    Browse the repository at this point in the history

  14. Fix CI Ethos-N settings 

    Change-Id: Idd955755d6f6d1cd3843462f627d0d952729e467
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    3eacad8 View commit details
    Browse the repository at this point in the history

  15. Removed unnecessary line in infra 

    Change-Id: I0ea866adf5d9166db85dd82d013a631d991ae633
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    dc48617 View commit details
    Browse the repository at this point in the history

  16. Remove unnecessary len in infra 

    Change-Id: I869e8233d41c6ab7c2dc80f47d976c974043b80c
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    696a6d6 View commit details
    Browse the repository at this point in the history

  17. Rename 'cpu_ops' to 'host_ops' 

    Change-Id: I79a6ffcfd48cd055d279f493c672ec82f0c68e5c
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    80fb108 View commit details
    Browse the repository at this point in the history

  18. Added explanation on mocking 

    Change-Id: I1e88c07a47464e44cb45c6a327ec9c7e2d70cc94
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    df6e6d0 View commit details
    Browse the repository at this point in the history

  19. IsEthosOp -> IsEthosnOp 

    Change-Id: I4fc1b462a74f8fae231ebafac614dd8d45be0feb
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    c81af10 View commit details
    Browse the repository at this point in the history

  20. Improve documentation in ethosn_api.h 

    Change-Id: I5586a7ba7ce71da667a6a9c6dd2e591028eb43b2
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    d39524c View commit details
    Browse the repository at this point in the history

  21. No longer iterate over module when compiling 

    Change-Id: I80e1d494c6d574be06a2375e831343485712914d
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    3014543 View commit details
    Browse the repository at this point in the history

  22. Move EthosnCompiler implementations into codegen.cc 

    Change-Id: I5bb6e9f62722d930d9dc040ac62bf87f29dd74c5
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    c478165 View commit details
    Browse the repository at this point in the history

  23. Fix linting 

    Change-Id: Ia44ec741a5330ad289cc6b5cd2bb1ed784fe6afc
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    abb1066 View commit details
    Browse the repository at this point in the history

  24. Refactor EthosnAPI compilation functions into EthosnCompiler 

    Change-Id: Iee0aecbe43a84fefb437ab9ff064e3f8b42c80a4
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    5cb6d9c View commit details
    Browse the repository at this point in the history

  25. Improve docs for Tvm2Npu 

    Change-Id: Ia39e9e1508513ca39c1d585fbccc3ae38fcbb9fb
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    186c92e View commit details
    Browse the repository at this point in the history

  26. Move more implementation out of headers 

    Change-Id: I1e33084ceb520b75f06b4d7a4acff5b9b2225bd5
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    6a967e7 View commit details
    Browse the repository at this point in the history

  27. Move implementation in ethosn_api.h 

    Change-Id: I51ab386892a2aa84aa47d03641aac8468f5737ae
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    c1b5b96 View commit details
    Browse the repository at this point in the history

  28. Improve docs for capabilities.h 

    Change-Id: Iaaee508aafa1cbb7650a04ed87bd6c1b91823a58
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    d12983d View commit details
    Browse the repository at this point in the history

  29. Use else() in cmake 

    Change-Id: I4b64a87f32b3616ec87c9937d9fc998b8dc5d7b4
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    93c5091 View commit details
    Browse the repository at this point in the history

  30. Use GetDataSize 

    Change-Id: I16988f3adbe6e03fc47fa0a77cb5febb7a02eaab
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    5e62110 View commit details
    Browse the repository at this point in the history

  31. Use const& 

    Change-Id: I664982d219f9a7d1f961dbfe84d12f66e2e5f5cb
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    d9b5e22 View commit details
    Browse the repository at this point in the history

  32. Fix python linting 

    Change-Id: Id965ccc037fd40cbdfcb58d922cc8d5fb8c87dfe
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    d06da5a View commit details
    Browse the repository at this point in the history

  33. Remove load/save to file 

    Change-Id: I7f8c3f5c8948c3f15551d28e3fee6e00120663ef
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    c6a0c1b View commit details
    Browse the repository at this point in the history

  34. data->data 

    Change-Id: Ifb861ebbfeaaf4b154f4b1515f83a46aecf86e50
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    4fe1a6f View commit details
    Browse the repository at this point in the history

  35. Remove specific cpu target 

    Change-Id: I920568cc7a81cd77d44f8604f571340a330f3e62
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    ae17572 View commit details
    Browse the repository at this point in the history

  36. Test export/load module 

    Change-Id: Ib605458127485e2015ac012ec515ced5900705f3
    @mbaret
    mbaret committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    57d1569 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2020

  1. Fix cmake garbage 

    Change-Id: I32f3c967192c7c278ef33c52cac5fb5da682cd1b
    @mbaret
    mbaret committed Aug 15, 2020
    Configuration menu
    Copy the full SHA
    3ab99dd View commit details
    Browse the repository at this point in the history