Skip to content

Commit

Permalink
fix(tests): Adjust the test data to match the new version of LayoutPr…
Browse files Browse the repository at this point in the history
…edictor (#82)

* fix(tests): Adjust the test data to match the new version of LayoutPredictor from docling-ibm-models

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

* chore: Update poetry to use `docling-ibm-models` at version `v1.2.0`

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

---------

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
  • Loading branch information
nikos-livathinos authored Sep 17, 2024
1 parent 30a0ef6 commit fa9699f
Show file tree
Hide file tree
Showing 3 changed files with 16 additions and 11 deletions.
15 changes: 5 additions & 10 deletions poetry.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ packages = [{include = "docling"}]
python = "^3.10"
pydantic = "^2.0.0"
docling-core = "^1.3.0"
docling-ibm-models = "^1.1.7"
docling-ibm-models = "^1.2.0"
deepsearch-glm = "^0.21.0"
filetype = "^1.2.0"
pypdfium2 = "^4.30.0"
Expand Down
10 changes: 10 additions & 0 deletions tests/data/redp5110.md
Original file line number Diff line number Diff line change
Expand Up @@ -1776,6 +1776,10 @@ An important design and implementation consideration is the fact that RCAC colum

An example of this situation is shown in Figure 6-1. However, note that aggregate functions (a form of grouping) are based on masked values.

SELECT

FROM GROUP BY ORDER BY

## Without RCAC Masking

## With RCAC Masking
Expand Down Expand Up @@ -1808,6 +1812,12 @@ Figure 6-1 Timing of column masking
| **** **** **** 1234 | 750.33 |
| **** **** **** 0001 | 10.00 |

CREDIT_CARD_NUMBER, SUM(AMOUNT) AS TOTAL TRANSACTIONS

CREDIT_CARD_NUMBER

CREDIT_CARD_NUMBER;

Conversely, field procedure masking causes the column values to be changed (that is, masked) and stored in the row. When the table is queried and the masked columns are referenced, the masked data is used for any local selection, joining, grouping, or ordering operations. This situation can have a profound effect on the query's final result set and not just on the column values that are returned. Field procedure masking occurs when the column values are read from disk before any query processing. RCAC masking occurs when the column values are returned to the application after query processing. This difference in behavior is shown in Figure 6-2.

Note: Column masks can influence an SQL INSERT or UPDATE . For example, you cannot insert or update a table with column access control activated with masked data generated from an expression within the same statement that is based on a column with a column mask.
Expand Down

0 comments on commit fa9699f

Please sign in to comment.