Code

feat!: Docling v2#117

Code

Merged

dolfim-ibm merged 117 commits intomainDS4SD/docling:mainfrom cau/input-format-abstractionDS4SD/docling:cau/input-format-abstractionCopy head branch name to clipboardOct 16, 2024

+15,201-3,849

Commits

Commits on Sep 20, 2024

• Reorganize imports from docling-core

  Show description for abb6ddd
  cau-git

  committed
  abb6ddd

  Copy full SHA for abb6ddd

• Put stub for experimental format export

  Show description for ac51a09
  cau-git

  committed
  ac51a09

  Copy full SHA for ac51a09

Commits on Sep 23, 2024

• Lots of import refactoring

  Show description for 12477c8
  cau-git

  committed
  12477c8

  Copy full SHA for 12477c8

• Merge branch 'main' of github.com:DS4SD/docling into cau/experimental-format

  cau-git

  committed
  257d44a

  Copy full SHA for 257d44a

• Add exporter methods to new types

  Show description for d790731
  cau-git

  committed
  d790731

  Copy full SHA for d790731

Commits on Sep 24, 2024

• Add experimental output in glm_model

  Show description for b54956c
  cau-git

  committed
  b54956c

  Copy full SHA for b54956c

• Merge from main

  Show description for 867e06f
  cau-git

  committed
  867e06f

  Copy full SHA for 867e06f

• Switch everything to use label enum, and more

  Show description for 33373ac
  cau-git

  committed
  33373ac

  Copy full SHA for 33373ac

• Update lockfile

  Show description for 850a521
  cau-git

  committed
  850a521

  Copy full SHA for 850a521

Commits on Sep 25, 2024

• [WIP] introducting extra backend abstraction and input formats

  Show description for 95c5395
  cau-git

  committed
  95c5395

  Copy full SHA for 95c5395

• Apply renamings to DocItemLabel

  Show description for 3efc2bb
  cau-git

  committed
  3efc2bb

  Copy full SHA for 3efc2bb

• Sync test data from main

  Show description for 48d8b7b
  cau-git

  committed
  48d8b7b

  Copy full SHA for 48d8b7b

• Update GT test files for pages

  Show description for ad2bd71
  cau-git

  committed
  ad2bd71

  Copy full SHA for ad2bd71

• Examples: Don't export experimental output by default

  Show description for ba9d115
  cau-git

  committed
  ba9d115

  Copy full SHA for ba9d115

• Bump deepsearch-glm

  Show description for 0ee82a5
  cau-git

  committed
  0ee82a5

  Copy full SHA for 0ee82a5

Commits on Sep 26, 2024

• Merge from main

  cau-git

  committed
  9ffd1dc

  Copy full SHA for 9ffd1dc

Commits on Sep 27, 2024

• Import rewrites, adapt to changes in docling-core

  Show description for 2461b56
  cau-git

  committed
  2461b56

  Copy full SHA for 2461b56

• Renaming changes

  Show description for 91ab382
  cau-git

  committed
  91ab382

  Copy full SHA for 91ab382

Commits on Sep 30, 2024

• Repinning

  Show description for 0a86529
  cau-git

  committed
  0a86529

  Copy full SHA for 0a86529

• Merge branch 'cau/experimental-format' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  cd06d89

  Copy full SHA for cd06d89

Commits on Oct 1, 2024

• Fundamental refactoring for multi-format support

  Show description for 1fa7cd9
  cau-git

  committed
  1fa7cd9

  Copy full SHA for 1fa7cd9

Commits on Oct 4, 2024

• Working on a first version of DOCX native backend

  Show description for cefc34e
  

  Maxim Lysak

  committed
  cefc34e

  Copy full SHA for cefc34e

Commits on Oct 7, 2024

• Add comments

  Show description for e613f7b
  cau-git

  committed
  e613f7b

  Copy full SHA for e613f7b

• Improved docx parsing

  Show description for 1346843
  

  Maxim Lysak

  committed
  1346843

  Copy full SHA for 1346843

• Added mspowerpoint backend first implementation, improvements on msword backend

  Show description for bea9fc2
  

  Maxim Lysak

  committed
  bea9fc2

  Copy full SHA for bea9fc2

• Improved demo code, that saves output mds to files

  Show description for f773d8a
  

  Maxim Lysak

  committed
  f773d8a

  Copy full SHA for f773d8a

Commits on Oct 8, 2024

• Added HTML backend implementation, few improvements for other backends

  Show description for 89e58ca
  

  Maxim Lysak

  committed
  89e58ca

  Copy full SHA for 89e58ca

• Updates for Powerpoint backend

  Show description for 1d55cbd
  cau-git

  committed
  1d55cbd

  Copy full SHA for 1d55cbd

• Merge from main

  Show description for c044720
  cau-git

  committed
  c044720

  Copy full SHA for c044720

• Improved backends

  Show description for 07d952a
  

  Maxim Lysak

  committed
  07d952a

  Copy full SHA for 07d952a

• Lots of improvements

  Show description for 203cf19
  cau-git

  committed
  203cf19

  Copy full SHA for 203cf19

• Merge from upstream

  Show description for 080042d
  cau-git

  committed
  080042d

  Copy full SHA for 080042d

Commits on Oct 9, 2024

• Update examples and test cases

  Show description for 0dfbd0b
  cau-git

  committed
  0dfbd0b

  Copy full SHA for 0dfbd0b

• Merge from main, update OCR model and test cases

  Show description for b5a2738
  cau-git

  committed
  b5a2738

  Copy full SHA for b5a2738

• Fixes for docx backend

  Show description for da0700f
  

  Maxim Lysak

  committed
  da0700f

  Copy full SHA for da0700f

Commits on Oct 10, 2024

• Refactor test data, legacy usage and more

  Show description for 7cad290
  cau-git

  committed
  7cad290

  Copy full SHA for 7cad290

• Added verify_conversion_result_v2, Regenerate v1 and v2 test data

  Show description for 99cfea3
  cau-git

  committed
  99cfea3

  Copy full SHA for 99cfea3

• pin updates compatible with each other

  Show description for 50c05b2
  dolfim-ibm

  committed
  50c05b2

  Copy full SHA for 50c05b2

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  dolfim-ibm

  committed
  c310457

  Copy full SHA for c310457

• update pinning

  Show description for bde8186
  dolfim-ibm

  committed
  bde8186

  Copy full SHA for bde8186

• list all PIL supported mime types

  Show description for a84ba6d
  dolfim-ibm

  committed
  a84ba6d

  Copy full SHA for a84ba6d

• add example PNG

  Show description for 3794f82
  dolfim-ibm

  committed
  3794f82

  Copy full SHA for 3794f82

• pin docling-parse release

  Show description for 1bcad33
  dolfim-ibm

  committed
  1bcad33

  Copy full SHA for 1bcad33

• Added verify_conversion_result_v2, Regenerate v1 and v2 test data

  Show description for cd72ea2
  cau-git

  committed
  cd72ea2

  Copy full SHA for cd72ea2

• Update test cases for v2

  cau-git

  committed
  7aad3dc

  Copy full SHA for 7aad3dc

Commits on Oct 11, 2024

• use new interface in minimal example

  Show description for 051beae
  dolfim-ibm

  committed
  051beae

  Copy full SHA for 051beae

• More renaming, design enrichment interface

  Show description for 304d160
  cau-git

  committed
  304d160

  Copy full SHA for 304d160

• Backend error handling fixes

  Show description for 025983f
  cau-git

  committed
  025983f

  Copy full SHA for 025983f

• Merge remote-tracking branch 'origin/main' into cau/input-format-abstraction

  Show description for 331ab36
  dolfim-ibm

  committed
  331ab36

  Copy full SHA for 331ab36

• fix generation enabled

  Show description for cc9bcc4
  dolfim-ibm

  committed
  cc9bcc4

  Copy full SHA for cc9bcc4

• Optionally produce legacy_doc

  Show description for 52713f0
  cau-git

  committed
  52713f0

  Copy full SHA for 52713f0

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  3ee97c4

  Copy full SHA for 3ee97c4

• use options objects

  Show description for c6e1471
  dolfim-ibm

  committed
  c6e1471

  Copy full SHA for c6e1471

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  dolfim-ibm

  committed
  786b89e

  Copy full SHA for 786b89e

• add GlmOptions

  Show description for 94b5e15
  dolfim-ibm

  committed
  94b5e15

  Copy full SHA for 94b5e15

• fixes

  Show description for 753f67a
  dolfim-ibm

  committed
  753f67a

  Copy full SHA for 753f67a

• feat!: simplify conversion API (#139)

  Show description for 136f16e
  vagenas

  authored
  136f16e

  Copy full SHA for 136f16e

• Change code to use unordered/ordered list, robustifications

  Show description for 95c1f80
  cau-git

  committed
  95c1f80

  Copy full SHA for 95c1f80

• Merge from simplify-conv-api

  Show description for d0fccb9
  cau-git

  committed
  d0fccb9

  Copy full SHA for d0fccb9

• initial refactor iteration

  Show description for ca2a96d
  dolfim-ibm

  committed
  ca2a96d

  Copy full SHA for ca2a96d

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  dolfim-ibm

  committed
  5b5c99e

  Copy full SHA for 5b5c99e

• fix default _enrich_document

  Show description for 6c9f869
  dolfim-ibm

  committed
  6c9f869

  Copy full SHA for 6c9f869

• Add image format support to PdfBackend

  Show description for 6efcf0a
  cau-git

  committed
  6efcf0a

  Copy full SHA for 6efcf0a

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  2a259b9

  Copy full SHA for 2a259b9

• Bump docling-core version

  Show description for 69f0ab4
  cau-git

  committed
  69f0ab4

  Copy full SHA for 69f0ab4

• rename and refactor *model*

  Show description for 98f1a45
  dolfim-ibm

  committed
  98f1a45

  Copy full SHA for 98f1a45

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  Show description for 7f10a54
  dolfim-ibm

  committed
  7f10a54

  Copy full SHA for 7f10a54

• missing renamed files

  Show description for 941b51a
  dolfim-ibm

  committed
  941b51a

  Copy full SHA for 941b51a

Commits on Oct 13, 2024

• propagate raises, add enrichment model, some renaming

  Show description for c1ed447
  dolfim-ibm

  committed
  c1ed447

  Copy full SHA for c1ed447

• use new PictureData

  Show description for 7c8d7e2
  dolfim-ibm

  committed
  7c8d7e2

  Copy full SHA for 7c8d7e2

• use do_ flag in pipeline_options

  Show description for ddb5096
  dolfim-ibm

  committed
  ddb5096

  Copy full SHA for ddb5096

• pin picture data with molecule

  Show description for 245b6c4
  dolfim-ibm

  committed
  245b6c4

  Copy full SHA for 245b6c4

Commits on Oct 14, 2024

• fix artifacts_path via pipeline_options

  Show description for ab8f715
  dolfim-ibm

  committed
  ab8f715

  Copy full SHA for ab8f715

• use self.artifacts_path

  Show description for 08ab628
  dolfim-ibm

  committed
  08ab628

  Copy full SHA for 08ab628

• Updated pptx backend, fixes issues with lists, also added more different list cases to example

  Show description for e87bf9a
  

  Maxim Lysak

  committed
  e87bf9a

  Copy full SHA for e87bf9a

• Big refactoring for legacy_document support

  Show description for 497ddb3
  cau-git

  committed
  497ddb3

  Copy full SHA for 497ddb3

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  a50ba57

  Copy full SHA for a50ba57

• Update example export code

  Show description for 3f0b017
  cau-git

  committed
  3f0b017

  Copy full SHA for 3f0b017

• added support for enumerated lists

  Show description for 98ca58f
  

  Maxim Lysak

  committed
  98ca58f

  Copy full SHA for 98ca58f

• Fix generate_multimodal_pages

  Show description for 57de8ad
  cau-git

  committed
  57de8ad

  Copy full SHA for 57de8ad

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  b964c4b

  Copy full SHA for b964c4b

• renaming BaseTableData

  Show description for 5b33b12
  cau-git

  committed
  5b33b12

  Copy full SHA for 5b33b12

Commits on Oct 15, 2024

• small corrections to pptx

  

  Maxim Lysak

  committed
  aa22fd3

  Copy full SHA for aa22fd3

• Update CLI

  Show description for afafb97
  cau-git

  committed
  afafb97

  Copy full SHA for afafb97

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  8710506

  Copy full SHA for 8710506

• Import statement updates from docling-core

  Show description for dac82ca
  cau-git

  committed
  dac82ca

  Copy full SHA for dac82ca

• switch convert_all output type from Iterable to Iterator (#143)

  Show description for 6b8835b
  vagenas

  authored
  6b8835b

  Copy full SHA for 6b8835b

• Merge remaining changes from main

  Show description for fa5d972
  cau-git

  committed
  fa5d972

  Copy full SHA for fa5d972

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  d687f93

  Copy full SHA for d687f93

• Fixes for lists handling in docx

  Show description for 115435a
  

  Maxim Lysak

  committed
  115435a

  Copy full SHA for 115435a

• pin docling-core and glm

  Show description for f49d788
  dolfim-ibm

  committed
  f49d788

  Copy full SHA for f49d788

• Enable mypy and fix many reported errors

  Show description for 27f4ed3
  cau-git

  committed
  27f4ed3

  Copy full SHA for 27f4ed3

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  a66c4ee

  Copy full SHA for a66c4ee

• CLI and error handling fixes

  Show description for ba9eaf1
  cau-git

  committed
  ba9eaf1

  Copy full SHA for ba9eaf1

• Merge from main and remove conflicts

  Show description for 84438bd
  cau-git

  committed
  84438bd

  Copy full SHA for 84438bd

• add v2 docs placeholder [skip ci] (#145)

  Show description for c1794a7
  

  vagenas

  and

  cau-git

  authored
  c1794a7

  Copy full SHA for c1794a7

• Change output folder for examples.

  Show description for 40bb84d
  cau-git

  committed
  40bb84d

  Copy full SHA for 40bb84d

• Adjust CI examples path

  Show description for 9d15f4d
  cau-git

  committed
  9d15f4d

  Copy full SHA for 9d15f4d

• Add migration instructions to doc (wip)

  Show description for 74e0452
  cau-git

  committed
  74e0452

  Copy full SHA for 74e0452

• add options to generate images

  Show description for 1cb11be
  dolfim-ibm

  committed
  1cb11be

  Copy full SHA for 1cb11be

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  dolfim-ibm

  committed
  75feef2

  Copy full SHA for 75feef2

• fix generation of images and adapt examples

  Show description for cd8e3dc
  dolfim-ibm

  committed
  cd8e3dc

  Copy full SHA for cd8e3dc

• Add migration instructions to doc (cont)

  Show description for df3ff47
  cau-git

  committed
  df3ff47

  Copy full SHA for df3ff47

Commits on Oct 16, 2024

• Update v2 documentation

  cau-git

  committed
  8a25230

  Copy full SHA for 8a25230

• pin models, core and adapt example

  Show description for dd2982c
  dolfim-ibm

  committed
  dd2982c

  Copy full SHA for dd2982c

• Update docling-core pinnings

  Show description for c123e5a
  cau-git

  committed
  c123e5a

  Copy full SHA for c123e5a

• apply changes to the picture data annotations

  Show description for d5f161d
  dolfim-ibm

  committed
  d5f161d

  Copy full SHA for d5f161d

• Update docling-core pinnings

  Show description for 515ab04
  cau-git

  committed
  515ab04

  Copy full SHA for 515ab04

• Added and fixed origin for msword and mspowerpoint backend

  Show description for a07a187
  

  Maxim Lysak

  committed
  a07a187

  Copy full SHA for a07a187

• Update docling-core pinnings

  Show description for 5c862b5
  cau-git

  committed
  5c862b5

  Copy full SHA for 5c862b5

• Merge branch 'cau/input-format-abstraction' of github.com:DS4SD/docling into cau/input-format-abstraction

  cau-git

  committed
  07206c5

  Copy full SHA for 07206c5

• Documentation updates, remove DescriptionItem in DoclingDocument init

  Show description for 734d77c
  cau-git

  committed
  734d77c

  Copy full SHA for 734d77c

• update RAG examples and banner text

  Show description for fb028b7
  vagenas

  committed
  fb028b7

  Copy full SHA for fb028b7

• Merge pull request #149 from DS4SD/update-rag-examples

  Show description for 0858ed9
  cau-git

  authored
  0858ed9

  Copy full SHA for 0858ed9

• simplify README, move content to docs

  Show description for b7d9761
  dolfim-ibm

  committed
  b7d9761

  Copy full SHA for b7d9761

• pin core and glm

  Show description for 4cead1e
  dolfim-ibm

  committed
  4cead1e

  Copy full SHA for 4cead1e

• apply pre-commit with new path

  Show description for 4918e11
  dolfim-ibm

  committed
  4918e11

  Copy full SHA for 4918e11