Tflite validation #438
Merged
Tflite validation #438
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
efficient-lite-uint8 efficient-lite-int8
valentina-kustikova
previously approved these changes
Nov 11, 2023
FenixFly
approved these changes
Nov 12, 2023
FenixFly
requested changes
Nov 12, 2023
| googlenet-v3|Mean: [123.675,116.28,103.53].<br>Input scale: [58.395,57.12,57.375].|-| | ||
| googlenet-v1-tf|Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.6735930 Granny Smith<br>0.0737855 piggy bank, penny bank<br>0.0155380 vase<br>0.0154004 pitcher, ewer<br>0.0136552 saltshaker, salt shaker| | ||
| googlenet-v2-tf|Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.9849940 Granny Smith<br>0.0010004 lemon<br>0.0009706 pomegranate<br>0.0006835 tennis ball<br>0.0006694 banana| | ||
| googlenet-v3|Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.9867674 Granny Smith<br> 0.0008529 bikini, two-piece<br>0.0005354 piggy bank, penny bank<br>0.0003701 pomegranate<br>0.0001682 pool table, billiard table, snooker table| |
There was a problem hiding this comment.
Посмотрела таблицу валидации results/validation/validation_results_openvino_public_models.md, там при выводе получаются совсем иные результаты. Посмотрите, пожалуйста. Имеет смысл исходную модель средствами inference_tensorflow.py и inference_openvino_sync_mode.py, возможно была ошибка при запуске OpenVINO и надо будет поправить результаты валидации данной модели там.
| googlenet-v3|Mean: [123.675,116.28,103.53].<br>Input scale: [58.395,57.12,57.375].|-| | ||
| googlenet-v1-tf|Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.7443183 junco, snowbird<br>0.0474523 brambling, Fringilla montifringilla<br>0.0457429 chickadee<br>0.0213391 goldfinch, Carduelis carduelis<br>0.0085102 house finch, linnet, Carpodacus mexicanus| | ||
| googlenet-v2-tf|Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.9265908 junco, snowbird<br>0.0166747 brambling, Fringilla montifringilla<br>0.0058714 chickadee<br>0.0026126 water ouzel, dipper<br>0.0022344 indigo bunting, indigo finch, indigo bird, Passerina cyanea| | ||
| googlenet-v3|Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.9488292 junco, snowbird<br>0.0005887 water ouzel, dipper<br>0.0004797 iron, smoothing iron<br>0.0003071 indigo bunting, indigo finch, indigo bird, Passerina cyanea<br>0.0002692 cleaver, meat cleaver, chopper| |
There was a problem hiding this comment.
Аналогичный вопрос.
| densenet-121| Mean: [123.675,116.28,103.53].<br>Input scale: [58.395,57.12,57.375].| 0.3022473 liner, ocean liner<br>0.1322417 breakwater, groin, groyne, mole, bulwark, seawall, jetty<br>0.1194588 container ship, containership, container vessel<br>0.0795097 drilling platform, offshore rig<br>0.0723070 dock, dockage, docking facility| | ||
| googlenet-v1-tf| Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.1235979 breakwater, groin, groyne, mole, bulwark, seawall, jetty<br> 0.1017586 liner, ocean liner<br>0.0949444 drilling platform, offshore rig<br>0.0817947 container ship, containership, container vessel<br>0.0486889 fireboat| | ||
| googlenet-v2-tf| Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.2662660 container ship, containership, container vessel<br>0.0966037 dock, dockage, docking facility<br> 0.0876837 breakwater, groin, groyne, mole, bulwark, seawall, jetty<br>0.0488674 beacon, lighthouse, beacon light, pharos<br>0.0343599 drilling platform, offshore rig| | ||
| googlenet-v3| Mean: [127.5, 127.5, 127.5].<br>Input scale: [127.5].|0.4653829 beacon, lighthouse, beacon light, pharos<br>0.3437532 breakwater, groin, groyne, mole, bulwark, seawall, jetty<br>0.0512180 submarine, pigboat, sub, U-boat<br>0.0174647 liner, ocean liner<br>0.0134649 lifeboat| |
There was a problem hiding this comment.
Аналогичный вопрос по результатам этой модели.
|
Создана Issue#456 касательно вопроса несовпадения результатов. |
valentina-kustikova
approved these changes
Dec 8, 2023
|
@FenixFly, посмотри, пожалуйста, и если все нормально, то залей в основную ветку. Спасибо! |
FenixFly
approved these changes
Dec 10, 2023
ismukhin
pushed a commit
to ismukhin/dl-benchmark
that referenced
this pull request
Dec 23, 2023
ismukhin
added a commit
to ismukhin/dl-benchmark
that referenced
this pull request
Dec 23, 2023
This reverts commit 9600804.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.