Code

Add Segment Anything Model (SAM)#22654

Code

Merged

ArthurZucker merged 184 commits intohuggingface:mainhuggingface/transformers:mainfrom ArthurZucker:add-samArthurZucker/transformers:add-samCopy head branch name to clipboardApr 19, 2023

+3,645-1

Commits

Commits on Apr 7, 2023

• initial commit

  ArthurZucker

  committed
  0d59baa

  Copy full SHA for 0d59baa

Commits on Apr 10, 2023

• keys match

  younesbelkada

  committed
  8798e62

  Copy full SHA for 8798e62

• update, fix conversion

  younesbelkada

  committed
  4acf7a2

  Copy full SHA for 4acf7a2

• fixes, inference working

  younesbelkada

  committed
  b0e2994

  Copy full SHA for b0e2994

• fix

  younesbelkada

  committed
  cd5cd0a

  Copy full SHA for cd5cd0a

• more fixes

  younesbelkada

  committed
  589a9fc

  Copy full SHA for 589a9fc

• more fixes

  younesbelkada

  committed
  17e624c

  Copy full SHA for 17e624c

• clean up

  younesbelkada

  committed
  f43619a

  Copy full SHA for f43619a

• more clean up

  younesbelkada

  committed
  8c30ac3

  Copy full SHA for 8c30ac3

Commits on Apr 11, 2023

• fix copies and add convext copied layer norm

  ArthurZucker

  committed
  dd19b15

  Copy full SHA for dd19b15

• stash

  ArthurZucker

  committed
  17aeb1b

  Copy full SHA for 17aeb1b

Commits on Apr 14, 2023

• pretty big upfate

  ArthurZucker

  committed
  f02408f

  Copy full SHA for f02408f

• cleaning

  ArthurZucker

  committed
  a062a2a

  Copy full SHA for a062a2a

• more cleaning

  ArthurZucker

  committed
  3572298

  Copy full SHA for 3572298

• fixup stuffs

  ArthurZucker

  committed
  878c9c5

  Copy full SHA for 878c9c5

• fix copies

  ArthurZucker

  committed
  4eb3eb1

  Copy full SHA for 4eb3eb1

• fix iinit

  ArthurZucker

  committed
  15937e7

  Copy full SHA for 15937e7

• update test removing tokenizer

  ArthurZucker

  committed
  bd7d2b4

  Copy full SHA for bd7d2b4

• nits

  ArthurZucker

  committed
  5370e35

  Copy full SHA for 5370e35

• add pretrained

  ArthurZucker

  committed
  51be4cc

  Copy full SHA for 51be4cc

• more nits

  ArthurZucker

  committed
  5d4ea59

  Copy full SHA for 5d4ea59

• remove tracking of pipeline

  ArthurZucker

  committed
  e740463

  Copy full SHA for e740463

• few fixes

  younesbelkada

  committed
  5e2c4ea

  Copy full SHA for 5e2c4ea

• update san and conversion script

  ArthurZucker

  committed
  3840fcd

  Copy full SHA for 3840fcd

• fix mask decoder and prompt encoder conversion

  younesbelkada

  committed
  63a6f75

  Copy full SHA for 63a6f75

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  71c5377

  Copy full SHA for 71c5377

• fixes

  younesbelkada

  committed
  12232d7

  Copy full SHA for 12232d7

• small update

  ArthurZucker

  committed
  272a470

  Copy full SHA for 272a470

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  89d8280

  Copy full SHA for 89d8280

• fix order

  ArthurZucker

  committed
  01e6b57

  Copy full SHA for 01e6b57

• fix

  younesbelkada

  committed
  93c5185

  Copy full SHA for 93c5185

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  b179571

  Copy full SHA for b179571

• fix image embeddings

  younesbelkada

  committed
  2ad8e6d

  Copy full SHA for 2ad8e6d

• nites

  ArthurZucker

  committed
  1d503cb

  Copy full SHA for 1d503cb

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  e754719

  Copy full SHA for e754719

• few fixes

  younesbelkada

  committed
  dba2be3

  Copy full SHA for dba2be3

• fix logits

  younesbelkada

  committed
  854b01b

  Copy full SHA for 854b01b

Commits on Apr 15, 2023

• clean up

  younesbelkada

  committed
  7409029

  Copy full SHA for 7409029

• fixes boxes inference

  younesbelkada

  committed
  23d358a

  Copy full SHA for 23d358a

• v1 AMG

  younesbelkada

  committed
  2e89bed

  Copy full SHA for 2e89bed

• clean up

  younesbelkada

  committed
  a770a51

  Copy full SHA for a770a51

• some clean up

  younesbelkada

  committed
  bb40cb0

  Copy full SHA for bb40cb0

Commits on Apr 16, 2023

• multi points support

  younesbelkada

  committed
  30da508

  Copy full SHA for 30da508

• amg working

  younesbelkada

  committed
  c4408c7

  Copy full SHA for c4408c7

• fixup

  younesbelkada

  committed
  4a3b75f

  Copy full SHA for 4a3b75f

• clean up

  younesbelkada

  committed
  88757f3

  Copy full SHA for 88757f3

• readme

  younesbelkada

  committed
  e2e88d0

  Copy full SHA for e2e88d0

• update toctree

  younesbelkada

  committed
  a246c96

  Copy full SHA for a246c96

• fix type hint

  younesbelkada

  committed
  a447563

  Copy full SHA for a447563

Commits on Apr 17, 2023

• multiple fixes

  younesbelkada

  committed
  b9fcddd

  Copy full SHA for b9fcddd

• fixup

  younesbelkada

  committed
  98bf922

  Copy full SHA for 98bf922

• fixes

  younesbelkada

  committed
  2a78a31

  Copy full SHA for 2a78a31

• updates

  younesbelkada

  committed
  70c7c61

  Copy full SHA for 70c7c61

• updates

  younesbelkada

  committed
  6b21e68

  Copy full SHA for 6b21e68

• more tests

  younesbelkada

  committed
  bc8c1b8

  Copy full SHA for bc8c1b8

• few fixes

  younesbelkada

  committed
  96e320f

  Copy full SHA for 96e320f

• Merge remote-tracking branch 'upstream/main' into HEAD

  younesbelkada

  committed
  09ccaea

  Copy full SHA for 09ccaea

• change to SamForMaskGeneration

  younesbelkada

  committed
  f382b8d

  Copy full SHA for f382b8d

• doc

  younesbelkada

  committed
  1c317db

  Copy full SHA for 1c317db

• fixup

  ArthurZucker

  committed
  2729dbc

  Copy full SHA for 2729dbc

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  39d611c

  Copy full SHA for 39d611c

• fix more tests

  younesbelkada

  committed
  5de1b08

  Copy full SHA for 5de1b08

• multiple fixes

  younesbelkada

  committed
  073e730

  Copy full SHA for 073e730

• fix CI tests

  younesbelkada

  committed
  2d27b47

  Copy full SHA for 2d27b47

• refactor processor

  younesbelkada

  committed
  7efbba2

  Copy full SHA for 7efbba2

• renamings

  ArthurZucker

  committed
  d467dbd

  Copy full SHA for d467dbd

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  0d9e20f

  Copy full SHA for 0d9e20f

• draft the pipeline

  ArthurZucker

  committed
  25c569b

  Copy full SHA for 25c569b

• refactor

  younesbelkada

  committed
  7c896b0

  Copy full SHA for 7c896b0

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  8810145

  Copy full SHA for 8810145

• fix tests

  younesbelkada

  committed
  9ffb2e1

  Copy full SHA for 9ffb2e1

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  47b12d1

  Copy full SHA for 47b12d1

• fix test

  younesbelkada

  committed
  20b90b9

  Copy full SHA for 20b90b9

• few cleanings

  younesbelkada

  committed
  aea7c6a

  Copy full SHA for aea7c6a

• fix test

  younesbelkada

  committed
  ba7a851

  Copy full SHA for ba7a851

• edit pipelien support chunking

  ArthurZucker

  committed
  2135c85

  Copy full SHA for 2135c85

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  5720970

  Copy full SHA for 5720970

• udate

  ArthurZucker

  committed
  4cfc51d

  Copy full SHA for 4cfc51d

• add slow tests

  younesbelkada

  committed
  c995f9f

  Copy full SHA for c995f9f

• fix nit

  younesbelkada

  committed
  2a8399d

  Copy full SHA for 2a8399d

• fixup

  younesbelkada

  committed
  2c60040

  Copy full SHA for 2c60040

• fix nit

  younesbelkada

  committed
  de963b8

  Copy full SHA for de963b8

• current chunk pipleine

  ArthurZucker

  committed
  5247ee2

  Copy full SHA for 5247ee2

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  80158a4

  Copy full SHA for 80158a4

• cast boxes in fp32

  younesbelkada

  committed
  be3fa6c

  Copy full SHA for be3fa6c

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  812359e

  Copy full SHA for 812359e

• nit

  younesbelkada

  committed
  8504910

  Copy full SHA for 8504910

• current updates

  ArthurZucker

  committed
  b515a62

  Copy full SHA for b515a62

• piepleine works

  ArthurZucker

  committed
  403cf44

  Copy full SHA for 403cf44

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  e426f3b

  Copy full SHA for e426f3b

• fixup

  ArthurZucker

  committed
  af4a7e3

  Copy full SHA for af4a7e3

Commits on Apr 18, 2023

• clean up config

  younesbelkada

  committed
  bc2a2da

  Copy full SHA for bc2a2da

• fix slow tests

  younesbelkada

  committed
  116b13a

  Copy full SHA for 116b13a

• fix slow tests

  younesbelkada

  committed
  ad34e9d

  Copy full SHA for ad34e9d

• clean up

  younesbelkada

  committed
  1926bc1

  Copy full SHA for 1926bc1

• update doc and pipeline

  ArthurZucker

  committed
  4a0532e

  Copy full SHA for 4a0532e

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  c896253

  Copy full SHA for c896253

• adds more slow tests

  younesbelkada

  committed
  88f2463

  Copy full SHA for 88f2463

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  7b123aa

  Copy full SHA for 7b123aa

• fix slow tests

  younesbelkada

  committed
  3ff5bfc

  Copy full SHA for 3ff5bfc

• cleaning

  ArthurZucker

  committed
  ff87e20

  Copy full SHA for ff87e20

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  97fb32b

  Copy full SHA for 97fb32b

• tests pass

  younesbelkada

  committed
  88f8453

  Copy full SHA for 88f8453

• add docstring

  younesbelkada

  committed
  cf5158e

  Copy full SHA for cf5158e

• fix copies

  younesbelkada

  committed
  1f17915

  Copy full SHA for 1f17915

• clean up

  younesbelkada

  committed
  bb48be9

  Copy full SHA for bb48be9

• support batch of images

  ArthurZucker

  committed
  dfccc0d

  Copy full SHA for dfccc0d

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  46e0ff1

  Copy full SHA for 46e0ff1

• style

  ArthurZucker

  committed
  6df9500

  Copy full SHA for 6df9500

• dummy is needed, add tests

  ArthurZucker

  committed
  ed99b54

  Copy full SHA for ed99b54

• fix slow tests

  younesbelkada

  committed
  c98e4c0

  Copy full SHA for c98e4c0

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  dd676be

  Copy full SHA for dd676be

• fix CI

  younesbelkada

  committed
  577d285

  Copy full SHA for 577d285

• update

  ArthurZucker

  committed
  afb449f

  Copy full SHA for afb449f

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  3a4f5e8

  Copy full SHA for 3a4f5e8

• adds more tests

  younesbelkada

  committed
  fd4dc82

  Copy full SHA for fd4dc82

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  6435187

  Copy full SHA for 6435187

• fixes

  younesbelkada

  committed
  c32f43a

  Copy full SHA for c32f43a

• fixes

  younesbelkada

  committed
  9886a53

  Copy full SHA for 9886a53

• fixup

  younesbelkada

  committed
  8b313a0

  Copy full SHA for 8b313a0

• fixes

  younesbelkada

  committed
  21e2f7e

  Copy full SHA for 21e2f7e

• few fixes

  younesbelkada

  committed
  b4a7e8b

  Copy full SHA for b4a7e8b

• filter

  younesbelkada

  committed
  9ffbc69

  Copy full SHA for 9ffbc69

• few fixes

  younesbelkada

  committed
  bbdd2ee

  Copy full SHA for bbdd2ee

• some refactor

  younesbelkada

  committed
  1950a16

  Copy full SHA for 1950a16

• touches finales

  younesbelkada

  committed
  1320e36

  Copy full SHA for 1320e36

• fix

  younesbelkada

  committed
  0fc8680

  Copy full SHA for 0fc8680

• style

  ArthurZucker

  committed
  e996e01

  Copy full SHA for e996e01

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  a5d8e92

  Copy full SHA for a5d8e92

• remove pipeline files

  ArthurZucker

  committed
  53499e3

  Copy full SHA for 53499e3

• fixes nits

  younesbelkada

  committed
  d4c4de9

  Copy full SHA for d4c4de9

• revert pipeline changes

  ArthurZucker

  committed
  0115cd9

  Copy full SHA for 0115cd9

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  75448c3

  Copy full SHA for 75448c3

• fix test

  younesbelkada

  committed
  8b60f3a

  Copy full SHA for 8b60f3a

• fixup

  ArthurZucker

  committed
  f326dfa

  Copy full SHA for f326dfa

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  53a9f0e

  Copy full SHA for 53a9f0e

• remove automodel for automatic mask generation

  ArthurZucker

  committed
  0b57836

  Copy full SHA for 0b57836

• fix failing torch tests

  ArthurZucker

  committed
  9f80285

  Copy full SHA for 9f80285

Commits on Apr 19, 2023

• update mdx

  ArthurZucker

  committed
  88b7ac9

  Copy full SHA for 88b7ac9

• revert removal of MODEL_FOR_AUTOMATIC_MASK_GENERATION_MAPPING

  ArthurZucker

  committed
  fc898ca

  Copy full SHA for fc898ca

• update sam config based on review

  Show description for 8e86426
  

  3 peoplecommitted
  8e86426

  Copy full SHA for 8e86426

• update low_resolution_masks -> pred_masks

  Show description for 818f476
  ArthurZucker

  committed
  818f476

  Copy full SHA for 818f476

• update processor docstring

  ArthurZucker

  committed
  480b8e3

  Copy full SHA for 480b8e3

• remove image processor import empty

  ArthurZucker

  committed
  ae79546

  Copy full SHA for ae79546

• update for testing

  ArthurZucker

  committed
  6cccfb3

  Copy full SHA for 6cccfb3

• output vision hidden states + clean recomm

  Show description for 2cb2d9e
  ArthurZucker

  committed
  2cb2d9e

  Copy full SHA for 2cb2d9e

• fixup

  ArthurZucker

  committed
  2d1b3bc

  Copy full SHA for 2d1b3bc

• fixup

  ArthurZucker

  committed
  e5b0af9

  Copy full SHA for e5b0af9

• remove unused

  ArthurZucker

  committed
  61a9ef5

  Copy full SHA for 61a9ef5

• Update src/transformers/models/sam/modeling_sam.py

  Show description for e121384
  

  ArthurZucker

  and

  sgugger

  authored
  e121384

  Copy full SHA for e121384

• Update src/transformers/models/sam/image_processing_sam.py

  Show description for cdb8c07
  

  ArthurZucker

  and

  sgugger

  authored
  cdb8c07

  Copy full SHA for cdb8c07

• nits

  ArthurZucker

  committed
  f9508f1

  Copy full SHA for f9508f1

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  cd9a8e8

  Copy full SHA for cd9a8e8

• fix

  younesbelkada

  committed
  db41554

  Copy full SHA for db41554

• fix CI tests and slow tests

  younesbelkada

  committed
  8eae6ef

  Copy full SHA for 8eae6ef

• replace with Amy's processor

  younesbelkada

  committed
  93a504c

  Copy full SHA for 93a504c

• clearer docstring

  younesbelkada

  committed
  8440530

  Copy full SHA for 8440530

• add SamVisionNeck

  younesbelkada

  committed
  93e1364

  Copy full SHA for 93e1364

• refactor - all CI tests should pass

  younesbelkada

  committed
  5800114

  Copy full SHA for 5800114

• fix broken import on Gcolab

  younesbelkada

  committed
  7228cb8

  Copy full SHA for 7228cb8

• few fixes here and there

  younesbelkada

  committed
  0c61d3b

  Copy full SHA for 0c61d3b

• fix another bug

  younesbelkada

  committed
  d7e805d

  Copy full SHA for d7e805d

• fix more bugs

  younesbelkada

  committed
  731d416

  Copy full SHA for 731d416

• update and merge

  ArthurZucker

  committed
  08eaaf9

  Copy full SHA for 08eaaf9

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  81be02c

  Copy full SHA for 81be02c

• correct ckpt

  younesbelkada

  committed
  c931b55

  Copy full SHA for c931b55

• address comments

  younesbelkada

  committed
  932a479

  Copy full SHA for 932a479

• add tips

  younesbelkada

  committed
  d71cabf

  Copy full SHA for d71cabf

• revert

  younesbelkada

  committed
  bbcbad1

  Copy full SHA for bbcbad1

• fix docstring

  younesbelkada

  committed
  4000130

  Copy full SHA for 4000130

• replace with SamModel

  younesbelkada

  committed
  b921294

  Copy full SHA for b921294

• make fixup

  younesbelkada

  committed
  5810f28

  Copy full SHA for 5810f28

• add support for bathed images and batch ed points

  ArthurZucker

  committed
  44542dc

  Copy full SHA for 44542dc

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into add-sam

  ArthurZucker

  committed
  cdb6aba

  Copy full SHA for cdb6aba

• make fixup this time, really

  younesbelkada

  committed
  b1f1686

  Copy full SHA for b1f1686

• Merge branch 'add-sam' of https://github.com/ArthurZucker/transformers into HEAD

  younesbelkada

  committed
  b391539

  Copy full SHA for b391539

• make fixup again and again

  younesbelkada

  committed
  2e44dd2

  Copy full SHA for 2e44dd2

• few fixes here and there, this should be the touche finale

  younesbelkada

  committed
  46c8937

  Copy full SHA for 46c8937

• Update docs/source/en/model_doc/sam.mdx

  younesbelkada

  authored
  ce8b35f

  Copy full SHA for ce8b35f

• fixup

  younesbelkada

  committed
  533d637

  Copy full SHA for 533d637

• correct checkpoints

  younesbelkada

  committed
  8308f3f

  Copy full SHA for 8308f3f

• correct name

  younesbelkada

  committed
  d958f14

  Copy full SHA for d958f14

• rm unneeded file

  younesbelkada

  committed
  8422b8f

  Copy full SHA for 8422b8f

• add notebook

  younesbelkada

  committed
  fb3827a

  Copy full SHA for fb3827a