add detectron2 support #322

kadirnar · 2021-12-30T19:51:49Z

Sahi algoritmasına detectron2 kütüphanesini eklenmesi amaçlanmıştır.

Yapılan Değişiklikler:

Model.py: class Detectron2Model(DetectionModel) sınıfı eklendi.
utils/detectron2.py: Test cfg kodu ve .pkl yolları eklendi.
tests/test_detectron2.py: Modelin test edilmesi için test_detectron2.py dosyası oluşturuldu.

fcakyon · 2021-12-30T20:07:39Z

@kadirnar katkilarindan dolayi cok tesekkurler, baya guzel duruyor PR 🚀

Kodlarini su basliktaki adimlari takip ederek isort ve black ile formatlayip commitleyip tekrar pushlayabilir misin forkuna?
https://github.com/obss/sahi#contributing

sahi/model.py

tests/test_detectron2.py

requirements.txt

.github/workflows/ci.yml

fcakyon · 2021-12-31T10:55:31Z

@kadirnar isort ve black ile tekrar formatlaman gerekiyor, sahi/model.py formati hata veriyor :)

model ağırlıkları yüklemek detectron2.py kütüphanesine gerek kalmadı

…ectron

kadirnar · 2022-01-03T14:49:52Z

Config_path değişkenin hatası halen devam etmektedir.

join() argument must be str, bytes, or os.PathLike object, not 'NoneType'
01/03/2022 17:46:48 - INFO - fvcore.common.checkpoint -   [Checkpointer] Loading from mask_rcnn_R_50_C4_3x.pth ...
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.cls_score.weight' to the model due to incompatible shapes: (446, 2048) in the checkpoint but (81, 2048) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.cls_score.bias' to the model due to incompatible shapes: (446,) in the checkpoint but (81,) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.bbox_pred.weight' to the model due to incompatible shapes: (1780, 2048) in the checkpoint but (320, 2048) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.bbox_pred.bias' to the model due to incompatible shapes: (1780,) in the checkpoint but (320,) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Some model parameters or buffers are not found in the checkpoint:
roi_heads.box_predictor.bbox_pred.{bias, weight}
roi_heads.box_predictor.cls_score.{bias, weight}
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   The checkpoint state_dict contains keys that are not used by the model:
  roi_heads.mask_head.deconv.{bias, weight}
  roi_heads.mask_head.predictor.{bias, weight}
Traceback (most recent call last):
  File "/home/kadir/Desktop/sahi/open.py", line 18, in <module>
    detection_model = Detectron2DetectionModel(
  File "/home/kadir/Desktop/sahi/sahi/model.py", line 70, in __init__
    self.load_model()
  File "/home/kadir/Desktop/sahi/sahi/model.py", line 536, in load_model
    metadata = MetadataCatalog.get(cfg.DATASETS.TRAIN[0])
IndexError: tuple index out of range

fcakyon · 2022-01-03T15:04:03Z

Config_path değişkenin hatası halen devam etmektedir.

join() argument must be str, bytes, or os.PathLike object, not 'NoneType'
01/03/2022 17:46:48 - INFO - fvcore.common.checkpoint -   [Checkpointer] Loading from mask_rcnn_R_50_C4_3x.pth ...
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.cls_score.weight' to the model due to incompatible shapes: (446, 2048) in the checkpoint but (81, 2048) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.cls_score.bias' to the model due to incompatible shapes: (446,) in the checkpoint but (81,) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.bbox_pred.weight' to the model due to incompatible shapes: (1780, 2048) in the checkpoint but (320, 2048) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.bbox_pred.bias' to the model due to incompatible shapes: (1780,) in the checkpoint but (320,) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Some model parameters or buffers are not found in the checkpoint:
roi_heads.box_predictor.bbox_pred.{bias, weight}
roi_heads.box_predictor.cls_score.{bias, weight}
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   The checkpoint state_dict contains keys that are not used by the model:
  roi_heads.mask_head.deconv.{bias, weight}
  roi_heads.mask_head.predictor.{bias, weight}
Traceback (most recent call last):
  File "/home/kadir/Desktop/sahi/open.py", line 18, in <module>
    detection_model = Detectron2DetectionModel(
  File "/home/kadir/Desktop/sahi/sahi/model.py", line 70, in __init__
    self.load_model()
  File "/home/kadir/Desktop/sahi/sahi/model.py", line 536, in load_model
    metadata = MetadataCatalog.get(cfg.DATASETS.TRAIN[0])
IndexError: tuple index out of range

su satirda metadata'yi cekemiyor config verilmedigi icin: metadata = MetadataCatalog.get(cfg.DATASETS.TRAIN[0]).

metadatayi ne icin cekiyordun configden?

kadirnar · 2022-01-03T15:24:05Z

Config_path değişkenin hatası halen devam etmektedir.

join() argument must be str, bytes, or os.PathLike object, not 'NoneType'
01/03/2022 17:46:48 - INFO - fvcore.common.checkpoint -   [Checkpointer] Loading from mask_rcnn_R_50_C4_3x.pth ...
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.cls_score.weight' to the model due to incompatible shapes: (446, 2048) in the checkpoint but (81, 2048) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.cls_score.bias' to the model due to incompatible shapes: (446,) in the checkpoint but (81,) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.bbox_pred.weight' to the model due to incompatible shapes: (1780, 2048) in the checkpoint but (320, 2048) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Skip loading parameter 'roi_heads.box_predictor.bbox_pred.bias' to the model due to incompatible shapes: (1780,) in the checkpoint but (320,) in the model! You might want to double check if this is expected.
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   Some model parameters or buffers are not found in the checkpoint:
roi_heads.box_predictor.bbox_pred.{bias, weight}
roi_heads.box_predictor.cls_score.{bias, weight}
01/03/2022 17:46:49 - WARNING - fvcore.common.checkpoint -   The checkpoint state_dict contains keys that are not used by the model:
  roi_heads.mask_head.deconv.{bias, weight}
  roi_heads.mask_head.predictor.{bias, weight}
Traceback (most recent call last):
  File "/home/kadir/Desktop/sahi/open.py", line 18, in <module>
    detection_model = Detectron2DetectionModel(
  File "/home/kadir/Desktop/sahi/sahi/model.py", line 70, in __init__
    self.load_model()
  File "/home/kadir/Desktop/sahi/sahi/model.py", line 536, in load_model
    metadata = MetadataCatalog.get(cfg.DATASETS.TRAIN[0])
IndexError: tuple index out of range

su satirda metadata'yi cekemiyor config verilmedigi icin: metadata = MetadataCatalog.get(cfg.DATASETS.TRAIN[0]).

metadatayi ne icin cekiyordun configden?

Veri seti hakkında bilgi almak için kullanıyorduk. Bunu farklı modüller ile çözmek için araştıracağım. Şuanlık en basit yöntem:

cfg.MODEL.ROI_HEADS.NUM_CLASSES =

fcakyon changed the title ~~Adding detectron2 models to the Sahi algorithm.~~ add detectron2 support Dec 30, 2021

fcakyon linked an issue Dec 30, 2021 that may be closed by this pull request

Question: Plans for Deterctron2? #176

Closed

fcakyon added the enhancement New feature or request label Dec 30, 2021

fcakyon assigned kadirnar Dec 30, 2021

fcakyon self-requested a review December 30, 2021 20:26

fcakyon reviewed Dec 31, 2021

View reviewed changes

sahi/model.py Outdated Show resolved Hide resolved

fcakyon reviewed Dec 31, 2021

View reviewed changes

tests/test_detectron2.py Outdated Show resolved Hide resolved

fcakyon reviewed Dec 31, 2021

View reviewed changes

requirements.txt Outdated Show resolved Hide resolved

fcakyon reviewed Dec 31, 2021

View reviewed changes

.github/workflows/ci.yml Outdated Show resolved Hide resolved

kadirnar and others added 19 commits January 2, 2022 00:00

model upload

10faea7

model upload

befe7df

detectron upload

3a28861

gitmodules file upload

ca9fb3a

Update .gitmodules

7823264

detectron2 prediction kodları düzenlendi.

2296b85

Delete .gitmodules

35d4738

Update ci.yml

d132d5f

Kodlara black ve isort işlemleri uygulandı.

6f6258a

kütüphaneler fonksiyonlar altında tanımlandı

0b2196b

requirements yapılan değişiklikler iptal edildi.

1ef9c6e

detectron modülü kullanarak model indirilecek

98f076e

model ağırlıkları yüklemek detectron2.py kütüphanesine gerek kalmadı

Delete detectron2.py

4dc10a5

Update ci.yml

9707126

Update test_detectron2.py

68c6ae7

Update model.py

11e12e3

update push

be78662

Update model.py

9667d73

Update test_detectron2.py

fee145e

fcakyon and others added 20 commits January 2, 2022 12:09

attempt to fix detectron tests

49a3d20

update detectron2 model

2474cd8

update detectron test

cae6649

fix detectron class

5c926f0

update tests

1852322

update workflows

b3e46fd

fix yolov5 test

422a95a

Merge branch 'detectron' of https://github.com/kadirnar/sahi into det…

ee5b2f4

…ectron

update tests

359b73e

fix tests for new postprocess

6201f12

fix tests

7b908cc

update workflows docstring

cc4e96d

install detectron on all platforms

fa3215a

update detectron2 notebooks

9961d75

Delete Detectron2.ipynb

e91443a

update detectron2 notebook

bfdea11

update detectron2 notebook

bcc9468

revert back sahi installation todetectron branch

4f46742

handle when config_path is None

7c83c1d

remove default config value

729137a

fcakyon added 5 commits January 3, 2022 23:21

add export_cfg_as_yaml detectron2 util

7a5113d

detectron model can load custom finetuned models

7bbd70a

Merge branch 'main' of https://github.com/kadirnar/sahi into detectron

bfe9981

reformat with isort

86f3206

Merge branch 'main' of https://github.com/kadirnar/sahi into detectron

5e2a7d5

fcakyon merged commit c7a930f into obss:main Jan 13, 2022

kadirnar deleted the detectron branch January 27, 2022 11:40

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add detectron2 support #322

add detectron2 support #322

kadirnar commented Dec 30, 2021

fcakyon commented Dec 30, 2021

fcakyon commented Dec 31, 2021

kadirnar commented Jan 3, 2022

fcakyon commented Jan 3, 2022 •

edited

Loading

kadirnar commented Jan 3, 2022 •

edited

Loading

add detectron2 support #322

add detectron2 support #322

Conversation

kadirnar commented Dec 30, 2021

fcakyon commented Dec 30, 2021

fcakyon commented Dec 31, 2021

kadirnar commented Jan 3, 2022

fcakyon commented Jan 3, 2022 • edited Loading

kadirnar commented Jan 3, 2022 • edited Loading

fcakyon commented Jan 3, 2022 •

edited

Loading

kadirnar commented Jan 3, 2022 •

edited

Loading